-- Logs begin at Wed 2022-09-07 12:22:54 UTC, end at Wed 2022-09-07 13:31:43 UTC. -- Sep 07 13:01:32.176681 dv-cinder-790535-42-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:01:32.185149 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:01:32 2022] *** Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: nodename: dv-cinder-790535-42-iscsi Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: machine: x86_64 Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: clock source: unix Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: pcre jit disabled Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: detected number of CPU cores: 4 Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: current working directory: / Sep 07 13:01:32.187120 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: your processes number limit is 47680 Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: your memory page size is 4096 bytes Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: detected max file descriptor number: 2048 Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: lock engine: pthread robust mutexes Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: thunder lock: enabled Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:01:32.187943 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:01:32.226100 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: Python main interpreter initialized at 0x55e7034a39c0 Sep 07 13:01:32.226100 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: python threads support enabled Sep 07 13:01:32.226100 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: your server socket listen backlog is limited to 100 connections Sep 07 13:01:32.226100 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:01:32.226477 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:01:32.226567 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: *** Operational MODE: preforking *** Sep 07 13:01:32.226800 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:01:32.226800 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: spawned uWSGI master process (pid: 105632) Sep 07 13:01:32.226999 dv-cinder-790535-42-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:01:32.227555 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: spawned uWSGI worker 1 (pid: 105633, cores: 1) Sep 07 13:01:32.227892 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: spawned uWSGI worker 2 (pid: 105634, cores: 1) Sep 07 13:01:32.228051 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:01:32.881159 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:01:32.889824 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:01:33.977834 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:01:33.977834 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Sep 07 13:01:33.978459 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:01:33.978459 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: from cryptography.utils import int_from_bytes Sep 07 13:01:33.978459 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:01:33.978459 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: from cryptography.utils import int_from_bytes Sep 07 13:01:33.978996 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:01:33.978996 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Sep 07 13:01:36.487879 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:01:36.488410 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:01:36.488509 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:01:36.488855 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:01:36.488937 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:01:36.489006 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:01:36.489169 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:01:36.489265 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:01:36.489523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:01:36.489613 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.489782 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:01:36.489871 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490173 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490271 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490526 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490632 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490853 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.490945 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491166 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491264 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491490 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491578 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491802 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.491898 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492216 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492390 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492485 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492712 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.492799 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493017 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493112 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-42-iscsi {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493339 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493424 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493652 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493753 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-42-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.493968 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494065 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494279 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494365 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494615 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494718 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.494936 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495023 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495262 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495399 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495567 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495753 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.495930 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496205 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496375 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496558 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496722 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496818 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.496990 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497166 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497334 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497483 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497642 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497800 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.497946 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498125 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498260 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498458 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498610 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498792 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.498924 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499109 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499249 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499510 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-42-iscsi {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499604 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499831 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.499952 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-42-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.500148 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.500304 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501084 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501217 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501459 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501552 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501811 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.501900 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502129 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502221 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502473 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502562 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502817 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.502916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503136 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503276 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503448 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503569 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503780 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.503928 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504110 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504242 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504432 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504554 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504739 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.504876 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505048 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505169 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505361 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505542 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505664 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505818 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.505992 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506111 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506278 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506403 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506580 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506702 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506844 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.506999 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507206 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507354 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507497 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507634 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507773 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.507988 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508170 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508309 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508409 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508491 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508568 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508704 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508872 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.508971 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509200 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509288 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509517 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509666 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509828 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.509959 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.510124 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.510272 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.510446 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.510594 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.510755 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.511101 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.511423 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.511619 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.511751 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.511942 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512072 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512259 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512402 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512574 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512715 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.512904 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513041 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513228 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513449 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513550 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513705 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.513859 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514024 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514185 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514368 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514626 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514723 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.514885 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.515277 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.515461 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.515597 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.515807 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.515975 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516358 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516577 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516665 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516905 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.516991 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.517234 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.517367 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.517551 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.517638 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.517865 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518000 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518168 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518260 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518503 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518608 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518820 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.518917 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519141 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519226 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519396 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519491 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519709 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.519805 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520021 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520109 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520347 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520432 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520655 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520753 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.520967 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521053 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521275 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521359 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521578 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521672 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521887 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.521974 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522198 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522289 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522540 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522656 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522841 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.522935 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523151 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523238 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523458 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523545 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523767 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.523853 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524078 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524165 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524388 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524482 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524695 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.524791 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525007 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525093 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525321 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525416 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525629 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525723 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.525937 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526036 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526246 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526335 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526581 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526670 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526894 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.526980 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527202 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527289 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527512 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527596 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527822 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.527909 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528131 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528217 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528438 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528532 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528741 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.528827 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529053 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529142 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529361 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529447 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529675 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529786 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.529980 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530068 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530286 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530371 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530622 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530723 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.530932 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531017 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531239 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531336 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531590 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.531971 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532059 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532293 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532395 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532598 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532739 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.532905 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533034 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533313 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533520 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533616 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533843 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.533929 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.534169 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.534254 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.534507 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.534600 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.534819 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.534918 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.535129 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.535215 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.535453 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:01:36.535541 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.535795 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.535893 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536134 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536256 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536477 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536563 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536792 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.536887 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537114 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537211 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537446 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537532 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537766 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.537852 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538080 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538210 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538397 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538542 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538745 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.538832 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539059 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539158 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539376 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539484 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539700 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.539788 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540018 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540121 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540339 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540426 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540655 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540757 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.540980 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541078 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541297 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541391 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541621 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541716 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.541935 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542030 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542259 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542343 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542617 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542705 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.542943 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543039 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543257 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543350 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543592 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543676 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543912 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.543999 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544236 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544322 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544554 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544640 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544876 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.544962 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545193 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545288 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545508 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545603 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545822 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.545910 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546142 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546228 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546496 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546603 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546814 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.546900 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.547632 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.547764 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.547964 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548360 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548459 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548594 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548681 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.548910 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549009 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549227 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549315 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549629 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549861 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.549957 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550181 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550268 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550530 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550634 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550855 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.550952 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551174 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551260 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551491 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551584 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551806 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.551894 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552118 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552204 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552430 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552525 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552743 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.552831 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553054 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553139 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553361 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553445 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553670 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553765 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.553983 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554077 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554292 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554378 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554643 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554740 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.554963 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555049 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555275 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555369 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555591 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555685 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.555903 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556038 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556221 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556321 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556535 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556624 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556846 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.556939 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557152 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557248 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557473 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557568 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557783 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.557869 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558088 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558183 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558447 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558561 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558746 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.558846 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559053 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559141 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559372 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559457 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559680 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559765 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.559996 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560083 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560313 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560406 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560628 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560715 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.560943 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561031 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561259 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561345 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561571 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561665 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561900 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.561989 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.562217 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.562311 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.562561 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.562665 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.563492 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.563628 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.563833 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564008 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564143 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564326 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564475 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564645 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564808 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.564961 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565271 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565436 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565582 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565749 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.565900 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566058 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566211 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566365 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566546 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566777 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.566865 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567093 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567182 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567401 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567487 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567734 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.567900 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568042 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568225 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568349 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568538 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568698 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.568916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569052 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569231 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569368 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569580 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569675 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569895 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.569993 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.570247 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.570335 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.570618 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.570708 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.570927 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571023 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571270 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571363 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571591 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571679 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.571917 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572005 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572235 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572322 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572551 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572636 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572865 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.572964 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573179 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573265 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573495 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573582 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573812 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.573899 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574124 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574211 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574469 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574576 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574789 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.574891 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575114 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575200 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575430 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575528 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575738 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.575824 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576059 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576145 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576380 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576474 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576690 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.576776 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577010 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577104 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577356 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577451 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577672 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577759 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.577993 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.578079 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.578310 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.578476 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.578764 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.578892 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579079 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579219 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579394 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579540 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579717 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.579869 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580036 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580190 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580354 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580518 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580679 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580836 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.580995 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581169 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581320 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581487 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581634 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581814 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.581963 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582127 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582280 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582477 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582630 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582816 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.582940 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583158 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583255 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583478 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583574 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583797 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.583885 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584126 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584221 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584443 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584531 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584762 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.584850 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585080 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585168 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585392 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585488 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585703 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.585790 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586012 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586100 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586323 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586452 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586664 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586808 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.586982 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587068 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587293 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587380 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587604 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587913 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.587999 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588221 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588308 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588530 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588623 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588834 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.588921 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589143 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589230 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589459 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589559 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589786 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.589872 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590099 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590193 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590428 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590530 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590744 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.590831 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591058 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591151 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591370 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591458 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591677 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591769 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.591987 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592075 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592293 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592388 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592600 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592695 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.592910 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593003 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593240 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593327 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593560 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593652 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593869 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.593964 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.594215 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.594311 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.594567 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.594690 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.594883 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595202 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595340 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595517 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595670 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595831 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.595992 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596157 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596309 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596476 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596630 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596790 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.596933 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597107 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597254 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597424 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597573 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597741 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.597905 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598058 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598222 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598387 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598565 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598724 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.598887 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599041 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599200 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599356 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599520 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599671 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599847 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.599988 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.600311 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.600425 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.600765 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.600861 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601092 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601205 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601421 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601515 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601781 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.601884 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602110 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602199 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602471 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602577 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602811 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.602900 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603131 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603228 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603446 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603534 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603758 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.603844 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604067 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604166 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604375 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604469 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604687 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.604774 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605001 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605095 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605307 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605393 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605615 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605701 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.605922 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606010 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606232 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606318 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606559 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606648 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.606871 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607004 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607177 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607262 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607488 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607574 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607798 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.607886 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608103 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608199 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608414 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608500 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608721 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.608815 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.609050 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.609136 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.609362 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.609462 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.610191 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.610291 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.610603 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.610761 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.610919 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611122 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611272 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611438 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611585 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611787 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.611930 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612127 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612268 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612618 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612798 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.612933 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613112 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613246 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613445 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613576 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613759 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.613889 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614072 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614199 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614383 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614536 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614728 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.614826 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615048 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615136 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615360 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615455 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615684 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.615786 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616003 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616104 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616321 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616416 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616634 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616721 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.616942 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617026 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617254 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617339 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617563 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617650 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617883 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.617977 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618197 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618282 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618531 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618624 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618840 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.618928 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619155 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619241 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619471 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619558 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619778 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.619863 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620091 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620185 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620399 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620484 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620718 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.620811 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621027 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621121 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621335 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621427 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621643 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621740 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.621960 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622057 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622276 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622373 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622611 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.622941 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623041 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623259 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623346 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623567 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623653 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623877 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.623965 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624187 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624272 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624495 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624580 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624801 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.624895 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.625116 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.625201 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626003 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626113 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626366 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626550 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626767 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.626867 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627089 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627224 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627403 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627492 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627716 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.627803 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628025 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628122 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628340 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628441 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628649 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628736 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.628959 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629056 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629264 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629353 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629574 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629668 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629880 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.629976 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630209 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630295 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630550 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630640 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630864 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.630968 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631171 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631478 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631574 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631826 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.631913 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632134 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632221 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632497 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632582 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632806 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.632901 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633126 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633213 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633448 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633534 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633766 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.633861 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634084 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634170 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634402 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634517 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634731 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.634819 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635051 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635138 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635368 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635461 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635687 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635774 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.635992 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636077 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636302 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636396 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636624 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636721 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.636940 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637026 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637256 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637353 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637579 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637666 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637904 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.637990 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638234 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638397 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638563 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638651 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638878 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.638966 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639190 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639332 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639505 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639591 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639816 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.639901 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.640394 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.640494 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.640721 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.640832 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641052 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641156 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641364 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641504 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641682 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641826 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.641998 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642143 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642314 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642478 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642656 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642797 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.642972 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643112 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643282 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643421 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643613 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643753 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.643929 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644066 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644239 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644373 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644553 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644697 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644862 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.644994 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.645179 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.645310 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.645494 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.645619 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.645926 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646052 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646246 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646369 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646591 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646711 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.646903 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647052 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647220 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647333 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647540 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647640 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647858 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.647948 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.648176 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.648264 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.648486 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.648573 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.648909 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649005 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649228 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649315 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649545 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649631 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649860 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.649956 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650166 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650252 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650493 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650584 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650810 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.650900 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651139 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651233 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651446 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651541 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651754 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.651841 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652062 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652150 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652389 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652494 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652695 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.652794 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653020 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653108 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653442 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653539 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653758 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.653844 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654067 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654153 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654509 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654611 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654826 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.654921 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655140 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655248 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655470 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655559 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655796 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.655892 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.656124 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.656211 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.656432 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657033 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657264 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657420 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657609 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657718 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657902 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.657990 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658234 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658324 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658576 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658667 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658900 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.658987 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659212 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659301 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659539 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659629 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659866 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.659963 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.660186 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.660290 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.660509 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.660595 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.660927 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661028 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661253 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661339 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661567 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661662 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661891 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.661986 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662218 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662312 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662552 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662646 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662859 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.662960 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663174 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663260 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663479 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663566 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663787 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.663884 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664111 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664199 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664419 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664507 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664731 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.664826 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665045 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665134 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665354 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665440 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665661 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665749 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.665964 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666050 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666290 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666384 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666618 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666716 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.666946 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667040 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667260 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667347 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667587 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667683 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.667916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668033 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668217 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668314 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668541 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668643 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668853 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.668940 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669160 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669255 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669465 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669551 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669770 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.669864 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670115 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670213 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670458 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670548 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670764 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.670851 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671099 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671199 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671433 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671520 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671746 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.671833 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.672080 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.672237 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.672944 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673033 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673265 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673351 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673580 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673668 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673898 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.673984 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674225 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674311 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674561 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674653 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674867 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.674956 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675181 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675280 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675485 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675573 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675793 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.675880 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676101 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676201 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676410 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676496 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676715 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.676801 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677019 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677113 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677324 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677413 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677647 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677733 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.677954 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678053 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678278 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678365 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678617 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678705 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.678935 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679055 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679230 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679323 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679540 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679627 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679884 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.679973 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680195 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680281 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680526 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680621 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680840 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.680935 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681165 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681260 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681486 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681805 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.681892 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682124 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682212 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682465 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682569 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682788 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.682877 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683108 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683194 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683424 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683520 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683737 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.683825 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684054 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684142 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684374 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684470 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684695 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.684782 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685213 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685299 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685546 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685646 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685862 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.685948 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686177 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686265 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686516 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686619 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686837 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.686932 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687155 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687242 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687467 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687556 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687807 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.687910 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688125 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688213 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688486 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688587 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688774 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.688921 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689098 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689195 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689427 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689514 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689764 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.689859 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690083 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690178 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690399 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690566 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690737 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.690825 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691054 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691162 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691414 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691730 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.691825 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692039 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692127 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692352 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692439 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692667 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692762 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.692981 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693077 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693300 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693395 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693616 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693716 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.693933 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694028 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694246 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694333 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694584 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694760 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694904 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.694993 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695220 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695306 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695538 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695635 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695865 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.695952 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696200 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696288 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696526 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696613 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696840 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.696927 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.697157 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.697244 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.697472 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.697560 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.697992 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.698134 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.698313 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.698400 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.698678 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.698767 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699009 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699108 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699340 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699428 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699657 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699752 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.699978 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700064 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700310 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700406 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700621 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700744 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.700929 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701018 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701243 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701339 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701555 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701642 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701861 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.701983 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702186 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702286 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702525 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702615 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702833 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.702931 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.703156 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.703252 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.703497 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.703704 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704032 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704121 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704388 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704479 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704710 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.704798 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705041 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705374 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705472 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705698 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.705785 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706008 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706101 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706335 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706438 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706674 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706761 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.706987 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707072 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707306 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707429 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707623 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707712 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.707933 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708029 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708241 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708328 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708554 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708641 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708869 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.708965 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709175 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709262 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709489 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709582 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709794 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.709891 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710124 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710218 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710451 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710765 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.710863 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711074 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711160 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711386 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711695 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711783 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.711998 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712132 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712305 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712392 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712608 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712696 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.712923 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713017 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713225 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713314 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713539 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713628 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713845 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.713933 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714159 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714246 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714533 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714624 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714848 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.714936 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715154 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715260 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715482 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715570 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715791 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.715879 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716098 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716193 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716419 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716508 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716734 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.716820 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717059 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717155 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717374 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717461 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717690 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.717784 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.718039 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.718135 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.718361 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.718482 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.718914 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.719518 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.719776 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.719912 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720103 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720230 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720443 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720580 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720781 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.720918 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721094 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721231 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721406 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721545 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721717 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.721854 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722050 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722184 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722371 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722524 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722719 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.722828 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723038 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723126 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723357 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723455 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723677 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723765 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.723993 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724082 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724311 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724408 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724628 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724716 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.724937 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725030 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725251 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725411 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725559 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725654 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725872 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.725960 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726183 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726272 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726522 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726626 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726841 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.726928 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727188 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727275 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727511 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727605 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727834 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.727929 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728150 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728245 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728475 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728573 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728784 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.728885 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729100 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729187 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729410 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729498 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729723 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.729824 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730043 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730131 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730376 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730483 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730722 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.730820 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.731028 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.731125 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.731705 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.731800 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732026 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732114 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732352 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732439 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732679 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732766 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.732996 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733085 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733325 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733410 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733653 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733740 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.733969 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.734063 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.734295 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.734389 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.734663 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.735417 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.735551 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.735763 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.735903 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736115 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736243 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736455 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736577 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736788 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.736877 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737102 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737190 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737416 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737506 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737726 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.737814 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738086 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738489 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738602 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738687 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738782 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.738865 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739120 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739327 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739416 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739634 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739770 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.739942 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740039 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740250 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740374 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740556 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740652 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740869 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.740977 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741179 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741268 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741483 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741571 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741788 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.741885 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742093 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742180 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742400 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742732 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.742830 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743038 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743124 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743346 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743432 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743650 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743746 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.743956 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744043 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744259 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744357 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744565 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744653 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744867 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.744955 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745204 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745301 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745545 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745634 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745868 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.745963 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746187 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746282 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746531 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746624 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746849 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.746936 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747164 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747265 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747494 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747582 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747813 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.747899 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748129 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748224 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748447 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748535 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748770 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.748863 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749086 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749174 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749403 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749497 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749718 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.749804 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750031 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750126 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750389 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750539 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750752 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.750839 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751085 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751224 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751400 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751562 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751734 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.751876 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752061 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752208 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752388 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752534 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.752859 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753031 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753181 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753371 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753498 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753691 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.753835 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754008 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754152 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754337 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754511 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754685 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.754784 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755005 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755095 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755328 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755461 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755652 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755744 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.755969 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756058 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756293 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756381 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756617 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756707 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.756947 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757034 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757277 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757374 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757594 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757682 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757907 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.757995 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.758240 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.758337 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.758600 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.758690 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.758927 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759017 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759259 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759360 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759601 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759688 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.759921 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760010 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760240 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760335 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760547 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760634 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.760794 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:01:36.760883 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:01:36.761095 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:01:36.914469 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO dbcounter [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Registered counter for database nova_api Sep 07 13:01:36.914671 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Registered counter for database nova_api Sep 07 13:01:36.935284 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:36.938592 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_db.sqlalchemy.engines [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:36.942382 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:36.945325 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writer thread running {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:36.999207 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.context [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4c90cff-9714-42a7-a691-82968d71f0dc(cell1) {{(pid=105634) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:01:37.002219 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.context [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4c90cff-9714-42a7-a691-82968d71f0dc(cell1) {{(pid=105633) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:01:37.003042 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:37.003521 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:37.005102 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:37.005860 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:37.006067 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:37.006261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:37.006572 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:37.008134 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:37.008269 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:37.008853 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:37.009294 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:37.010268 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Registered counter for database nova_cell0 Sep 07 13:01:37.012235 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_concurrency.lockutils [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:37.013323 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO dbcounter [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Registered counter for database nova_cell0 Sep 07 13:01:37.014406 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Registered counter for database nova_cell1 Sep 07 13:01:37.018081 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO dbcounter [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Registered counter for database nova_cell1 Sep 07 13:01:37.023316 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.025013 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.028393 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_db.sqlalchemy.engines [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.030260 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_db.sqlalchemy.engines [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.031446 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.033694 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.036969 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writer thread running {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.039285 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writer thread running {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.181252 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Registered counter for database nova_cell0 Sep 07 13:01:37.183106 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO dbcounter [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Registered counter for database nova_cell0 Sep 07 13:01:37.190576 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.194162 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG oslo_db.sqlalchemy.engines [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:01:37.195095 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.198587 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writer thread running {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:01:37.540628 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:01:37.543197 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: WARNING keystonemiddleware.auth_token [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:01:37.548103 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:01:37.550726 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: WARNING keystonemiddleware.auth_token [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:01:37.896999 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:01:37.903080 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:01:37.907469 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: WARNING keystonemiddleware.auth_token [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:01:37.908855 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7034a39c0 pid: 105634 (default app) Sep 07 13:01:37.910972 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:37.912162 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 Sep 07 13:01:37.912573 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Sep 7 13:01:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:37.913692 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: WARNING keystonemiddleware.auth_token [None req-b07f9081-255f-496b-b71e-6336aa3ba487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:01:37.919295 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7034a39c0 pid: 105633 (default app) Sep 07 13:02:59.947188 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:59.948273 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 07 13:02:59.948683 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:02:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:59.969584 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_api:SELECT=3 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.970676 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_cell1:SELECT=3 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.971842 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_cell0:SELECT=3 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.972766 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:00.826844 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-398ae3ab-719c-4f5f-95ee-7359633b63f9 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:00.858682 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-398ae3ab-719c-4f5f-95ee-7359633b63f9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902922 Sep 07 13:03:00.859511 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Sep 7 13:02:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:03.611774 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:03.612778 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4054841c-eb42-41bb-aacf-ab16378c133c None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 07 13:03:03.618732 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:04.085425 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-66a53bf1-3284-42b2-9204-68f1cce72a5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "swap": 0}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:04.132335 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-66a53bf1-3284-42b2-9204-68f1cce72a5f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510810 Sep 07 13:03:04.132942 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:04.147029 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.148163 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.150408 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.151503 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.363119 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-af6c0fda-2ec9-437c-ae1e-02ff1fbc1546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:04.430478 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-af6c0fda-2ec9-437c-ae1e-02ff1fbc1546 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288941 Sep 07 13:03:04.431075 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Sep 7 13:03:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:07.064936 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-66a53bf1-3284-42b2-9204-68f1cce72a5f admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:07.066094 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-66a53bf1-3284-42b2-9204-68f1cce72a5f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Sep 07 13:03:07.066530 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:07.727322 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-2f985ecd-153a-448d-820b-8e4e3568047d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:07.773322 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-2f985ecd-153a-448d-820b-8e4e3568047d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700338 Sep 07 13:03:07.774125 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:03:07.787086 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-aec375b8-b0ad-468f-aa0c-b2008b2732b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:07.822585 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-aec375b8-b0ad-468f-aa0c-b2008b2732b5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039684 Sep 07 13:03:07.823182 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Sep 7 13:03:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:10.474976 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-2f985ecd-153a-448d-820b-8e4e3568047d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:10.475991 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-2f985ecd-153a-448d-820b-8e4e3568047d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 07 13:03:10.476400 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:10.902616 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-241349fc-816f-4e79-8141-a588a69cb677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:10.924929 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-241349fc-816f-4e79-8141-a588a69cb677 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442068 Sep 07 13:03:10.925507 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:10.937504 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f7e3af16-e8ef-43cf-ab89-371c00cf4a20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:10.965064 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-f7e3af16-e8ef-43cf-ab89-371c00cf4a20 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031049 Sep 07 13:03:10.966104 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Sep 7 13:03:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:13.680566 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-241349fc-816f-4e79-8141-a588a69cb677 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:13.682674 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-241349fc-816f-4e79-8141-a588a69cb677 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Sep 07 13:03:13.683087 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:14.109904 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-65d6b4fb-9a52-478e-b465-2f8ec1416f82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:14.132208 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-65d6b4fb-9a52-478e-b465-2f8ec1416f82 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442874 Sep 07 13:03:14.133521 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:14.145708 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-2d0a4e2b-5154-48ab-8903-2935e218be3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:14.171491 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-2d0a4e2b-5154-48ab-8903-2935e218be3f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029879 Sep 07 13:03:14.172720 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Sep 7 13:03:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:16.862462 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-65d6b4fb-9a52-478e-b465-2f8ec1416f82 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:16.863495 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-65d6b4fb-9a52-478e-b465-2f8ec1416f82 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Sep 07 13:03:16.863920 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:03:17.286777 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:17.306163 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436222 Sep 07 13:03:17.306760 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:17.320847 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d3cfb81c-54d6-4aa0-9f5b-d4b0740d6638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:17.351792 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d3cfb81c-54d6-4aa0-9f5b-d4b0740d6638 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036198 Sep 07 13:03:17.361772 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Sep 7 13:03:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:20.173251 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:20.174302 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 07 13:03:20.174709 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:20.616082 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-6dabf80d-9142-4953-ba86-38f4771dcdaf admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:20.650827 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-6dabf80d-9142-4953-ba86-38f4771dcdaf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466480 Sep 07 13:03:20.651590 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Sep 7 13:03:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:23.403735 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:23.404759 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-e53f3a1e-3906-4abe-9f34-278960f3026d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 07 13:03:23.405208 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:23.807176 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-8b79db09-17d1-4815-bca6-ea685cc6208c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "swap": 0, "id": "1"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:23.827884 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-8b79db09-17d1-4815-bca6-ea685cc6208c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.415742 Sep 07 13:03:23.828437 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:03:23.841285 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-bce8232f-50cc-4f78-9bd3-1b0b0c6c80fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:23.869423 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-bce8232f-50cc-4f78-9bd3-1b0b0c6c80fe admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031799 Sep 07 13:03:23.870197 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Sep 7 13:03:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:26.522619 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-8b79db09-17d1-4815-bca6-ea685cc6208c admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:26.523624 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-8b79db09-17d1-4815-bca6-ea685cc6208c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 07 13:03:26.524025 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:26.914428 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-7f10aaf7-e046-4a54-b151-0a8a33f4c94e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:26.938429 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-7f10aaf7-e046-4a54-b151-0a8a33f4c94e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408278 Sep 07 13:03:26.939536 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:03:26.952961 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-6ccca340-5668-4136-b86e-04b02d54332e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:26.979048 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-6ccca340-5668-4136-b86e-04b02d54332e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029888 Sep 07 13:03:26.979620 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Sep 7 13:03:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:29.700679 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-7f10aaf7-e046-4a54-b151-0a8a33f4c94e admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:29.701713 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-7f10aaf7-e046-4a54-b151-0a8a33f4c94e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 07 13:03:29.702522 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:30.157566 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-39ade074-6662-48de-9ca1-f0412d8d2cce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:30.180253 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-39ade074-6662-48de-9ca1-f0412d8d2cce admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471227 Sep 07 13:03:30.181187 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:03:30.193612 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-e1a1c7c1-b085-4e3b-a772-541a68d3d1c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:30.198548 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:30.226649 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-e1a1c7c1-b085-4e3b-a772-541a68d3d1c3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036721 Sep 07 13:03:30.227256 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Sep 7 13:03:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:32.889076 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-39ade074-6662-48de-9ca1-f0412d8d2cce admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:32.889076 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-39ade074-6662-48de-9ca1-f0412d8d2cce admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 07 13:03:32.898274 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:33.384316 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-a083c88c-2232-435b-8dc1-b3072da61d80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "id": "4", "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:33.407325 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-a083c88c-2232-435b-8dc1-b3072da61d80 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.514032 Sep 07 13:03:33.408132 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:33.420195 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-9264458f-0bf1-430d-9ffd-24babfd1e1e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:33.447894 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-9264458f-0bf1-430d-9ffd-24babfd1e1e6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031311 Sep 07 13:03:33.448808 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Sep 7 13:03:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:36.105836 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-a083c88c-2232-435b-8dc1-b3072da61d80 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:36.107521 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-a083c88c-2232-435b-8dc1-b3072da61d80 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Sep 07 13:03:36.108171 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:36.557817 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:36.564025 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:36.580093 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465422 Sep 07 13:03:36.580839 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Sep 7 13:03:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:36.595984 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-7c78a30a-fa65-4d5e-b314-32e68a37cc2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:36.620564 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-7c78a30a-fa65-4d5e-b314-32e68a37cc2c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030760 Sep 07 13:03:36.621120 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Sep 7 13:03:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:52.972770 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:52.973792 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 07 13:03:52.974198 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:52.984829 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:53.363942 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-929c84f1-c52c-4843-b15f-341a5ebc1714 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:53.383213 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-929c84f1-c52c-4843-b15f-341a5ebc1714 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402821 Sep 07 13:03:53.383764 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Sep 7 13:03:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:03:54.692443 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:54.693457 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-896da7c1-bdfb-420c-bc3d-b779973b77df admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 07 13:03:54.693858 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:55.219441 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-757c0d48-b222-4a81-9fab-bc0f5f0fabfa admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:55.225461 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.wsgi [None req-757c0d48-b222-4a81-9fab-bc0f5f0fabfa admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-757c0d48-b222-4a81-9fab-bc0f5f0fabfa admin admin] Request method failure captured: Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept: application/json Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept-Encoding: gzip, deflate Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Connection: keep-alive Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Content-Length: 0 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Host: 10.222.0.65 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-System-Scope: None Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: User-Agent: python-novaclient Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Auth-Token: gAAAAABjGJa6_j0sd1wce36-KHQ0Z4XDQ3K53K8wmAk0dasGOJzymulLUaAWkdcKWCqUaaPyFWAIpHVUCLu62fmLPHTsOIuM_iW7wJBZPJ0_gHPV4H2BtKBJHRxLIol3wo2WjohJXMsoZwjqzmWJPHAecYdUZGjKPfI9Qg-dihiaMoR3e4S0oyg Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Id: None Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Name: None Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Identity-Status: Confirmed Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Is-Admin-Project: True Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Id: default Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Name: Default Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Name: admin Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Role: member,admin,reader Sep 07 13:03:55.228699 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Roles: member,admin,reader Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant: admin Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Name: admin Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User: admin Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Id: default Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Name: Default Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Name: admin Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: method: > Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: exception: Flavor 42 could not be found. Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: action_args: {'id': '42'} Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:55.230481 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:55.232724 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.234119 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-757c0d48-b222-4a81-9fab-bc0f5f0fabfa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:55.235590 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-757c0d48-b222-4a81-9fab-bc0f5f0fabfa admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398889 Sep 07 13:03:55.235590 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Sep 7 13:03:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:55.241069 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-7a8a5106-4872-4226-af7f-50e0c55a5b99 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:55.264492 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-7a8a5106-4872-4226-af7f-50e0c55a5b99 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027936 Sep 07 13:03:55.265044 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:55.277868 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-1c6e7c9f-7c61-4218-8c52-3c05b722feea admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:55.300262 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-1c6e7c9f-7c61-4218-8c52-3c05b722feea admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027780 Sep 07 13:03:55.300836 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:55.310615 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3368ee30-7f6c-4ec1-99f2-f79bd9322b76 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:55.316267 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-3368ee30-7f6c-4ec1-99f2-f79bd9322b76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3368ee30-7f6c-4ec1-99f2-f79bd9322b76 admin admin] Request method failure captured: Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Host: 10.222.0.65 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjGJa6_j0sd1wce36-KHQ0Z4XDQ3K53K8wmAk0dasGOJzymulLUaAWkdcKWCqUaaPyFWAIpHVUCLu62fmLPHTsOIuM_iW7wJBZPJ0_gHPV4H2BtKBJHRxLIol3wo2WjohJXMsoZwjqzmWJPHAecYdUZGjKPfI9Qg-dihiaMoR3e4S0oyg Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Role: member,admin,reader Sep 07 13:03:55.320258 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Roles: member,admin,reader Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User: admin Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: method: > Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: exception: Flavor 42 could not be found. Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: action_args: {'id': '42'} Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:55.321669 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:55.322523 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:55.323572 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3368ee30-7f6c-4ec1-99f2-f79bd9322b76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:55.324641 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-3368ee30-7f6c-4ec1-99f2-f79bd9322b76 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014627 Sep 07 13:03:55.324641 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Sep 7 13:03:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:56.558574 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-1c6e7c9f-7c61-4218-8c52-3c05b722feea admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:56.559594 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-1c6e7c9f-7c61-4218-8c52-3c05b722feea admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 07 13:03:56.559997 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:57.088224 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d3b39fd9-beaf-43aa-abb7-3e4aeabfa09a admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:57.093577 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-d3b39fd9-beaf-43aa-abb7-3e4aeabfa09a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d3b39fd9-beaf-43aa-abb7-3e4aeabfa09a admin admin] Request method failure captured: Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Host: 10.222.0.65 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjGJa81-rW_0K5N7k1oZpeZE0kSon1T6YmQEIhiKDcwvl8Kqs8O0C1PuhMt-f_xBbfLDA5fSrfPOK1dNnst6xdnPxSrerKZBm3bJIHsiTEKQCxtK8ErZeEkYPs-8rykG2epBQahArvU3YAJA93Z_wQ5I-mlMcGh0KBnpm00IhzRTzRe6c Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Role: member,admin,reader Sep 07 13:03:57.095128 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Roles: member,admin,reader Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User: admin Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: method: > Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: exception: Flavor 84 could not be found. Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: action_args: {'id': '84'} Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:57.096543 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:57.097506 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.099214 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d3b39fd9-beaf-43aa-abb7-3e4aeabfa09a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:57.100534 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d3b39fd9-beaf-43aa-abb7-3e4aeabfa09a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394783 Sep 07 13:03:57.100534 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Sep 7 13:03:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:57.106184 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-f5519c50-60f2-4a03-9969-8862dcb1e8a0 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:57.121321 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-f5519c50-60f2-4a03-9969-8862dcb1e8a0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018715 Sep 07 13:03:57.121847 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:57.131576 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-39bc8138-38c3-4ec5-998e-ff9fb7f7ba2d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:57.147183 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-39bc8138-38c3-4ec5-998e-ff9fb7f7ba2d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019709 Sep 07 13:03:57.147731 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:57.156966 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-026cfe61-ca4f-4d88-a939-9be566cecf74 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:57.162526 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.wsgi [None req-026cfe61-ca4f-4d88-a939-9be566cecf74 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-026cfe61-ca4f-4d88-a939-9be566cecf74 admin admin] Request method failure captured: Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept: application/json Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept-Encoding: gzip, deflate Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Connection: keep-alive Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Content-Length: 0 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Host: 10.222.0.65 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-System-Scope: None Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: User-Agent: python-novaclient Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Auth-Token: gAAAAABjGJa81-rW_0K5N7k1oZpeZE0kSon1T6YmQEIhiKDcwvl8Kqs8O0C1PuhMt-f_xBbfLDA5fSrfPOK1dNnst6xdnPxSrerKZBm3bJIHsiTEKQCxtK8ErZeEkYPs-8rykG2epBQahArvU3YAJA93Z_wQ5I-mlMcGh0KBnpm00IhzRTzRe6c Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Id: None Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Name: None Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Identity-Status: Confirmed Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Is-Admin-Project: True Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Id: default Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Name: Default Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Name: admin Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Role: member,admin,reader Sep 07 13:03:57.164021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Roles: member,admin,reader Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant: admin Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Name: admin Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User: admin Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Id: default Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Name: Default Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Name: admin Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: method: > Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: exception: Flavor 84 could not be found. Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: action_args: {'id': '84'} Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:57.165693 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:57.166711 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:57.168146 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-026cfe61-ca4f-4d88-a939-9be566cecf74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:57.169380 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-026cfe61-ca4f-4d88-a939-9be566cecf74 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011911 Sep 07 13:03:57.169380 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Sep 7 13:03:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 13:03:58.411876 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-39bc8138-38c3-4ec5-998e-ff9fb7f7ba2d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:58.412920 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-39bc8138-38c3-4ec5-998e-ff9fb7f7ba2d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 07 13:03:58.413349 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:58.954334 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-ea2f6177-f10b-4987-8fd5-a34f5d0b52b9 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:58.961366 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.wsgi [None req-ea2f6177-f10b-4987-8fd5-a34f5d0b52b9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-ea2f6177-f10b-4987-8fd5-a34f5d0b52b9 admin admin] Request method failure captured: Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept: application/json Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Accept-Encoding: gzip, deflate Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Connection: keep-alive Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Content-Length: 0 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Host: 10.222.0.65 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Openstack-System-Scope: None Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: User-Agent: python-novaclient Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Auth-Token: gAAAAABjGJa-gcn4-DNivX63CGXd2SIiVycApSYLGwY_O66GlHPsZgR0x_gzd8lj5XCARlu2Csme1HlSPUjOr-dV1-k1Ji6bxpvMS2Y6qcgoCGzPgCLdUjk7FU5-xsJVKrm8wBOZbIey073UPMcQS-k98ZBlgt4FVMoIgquAGTmVuC62w4tTKNs Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Id: None Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Domain-Name: None Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Identity-Status: Confirmed Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Is-Admin-Project: True Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Id: default Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Domain-Name: Default Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Project-Name: admin Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Role: member,admin,reader Sep 07 13:03:58.963307 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Roles: member,admin,reader Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant: admin Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-Tenant-Name: admin Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User: admin Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Id: default Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Domain-Name: Default Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: X-User-Name: admin Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: method: > Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: exception: Flavor 451 could not be found. Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: action_args: {'id': '451'} Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:58.964916 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:58.965884 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: ERROR nova.api.openstack.wsgi Sep 07 13:03:58.967257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-ea2f6177-f10b-4987-8fd5-a34f5d0b52b9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:58.968509 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-ea2f6177-f10b-4987-8fd5-a34f5d0b52b9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.415079 Sep 07 13:03:58.968509 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:03:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:58.975520 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-70ab3e47-10f6-4f10-a587-396e89562361 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:58.991168 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-70ab3e47-10f6-4f10-a587-396e89562361 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020004 Sep 07 13:03:58.991709 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:03:59.001033 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:59.015934 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018370 Sep 07 13:03:59.016466 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Sep 7 13:03:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:03:59.026119 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-299832e3-9752-4fc4-9577-dff1dceceb47 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:59.031499 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-299832e3-9752-4fc4-9577-dff1dceceb47 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-299832e3-9752-4fc4-9577-dff1dceceb47 admin admin] Request method failure captured: Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Host: 10.222.0.65 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjGJa-gcn4-DNivX63CGXd2SIiVycApSYLGwY_O66GlHPsZgR0x_gzd8lj5XCARlu2Csme1HlSPUjOr-dV1-k1Ji6bxpvMS2Y6qcgoCGzPgCLdUjk7FU5-xsJVKrm8wBOZbIey073UPMcQS-k98ZBlgt4FVMoIgquAGTmVuC62w4tTKNs Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Role: member,admin,reader Sep 07 13:03:59.032974 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Roles: member,admin,reader Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1f63c783a874e0c9130951b4f3e29a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Id: f1f63c783a874e0c9130951b4f3e29a3 Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User: admin Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Id: 8b2df08a50b742ecaff414e9c8135d6a Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: method: > Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: exception: Flavor 451 could not be found. Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: action_args: {'id': '451'} Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:59.034547 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:59.035425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 07 13:03:59.037261 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-299832e3-9752-4fc4-9577-dff1dceceb47 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:59.038467 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-299832e3-9752-4fc4-9577-dff1dceceb47 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011865 Sep 07 13:03:59.038467 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:03:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:00.254128 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:00.255709 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 07 13:04:00.256111 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:00.785180 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-288ff7ef-def2-411c-9737-6a3a88807b3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:00.805628 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-288ff7ef-def2-411c-9737-6a3a88807b3c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409923 Sep 07 13:04:00.806176 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Sep 7 13:04:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:02.030569 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:02.032395 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002236 Sep 07 13:04:02.032895 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:02.559484 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-cc9b5092-d568-4c04-a135-04c39acb32dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:02.578223 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-cc9b5092-d568-4c04-a135-04c39acb32dd admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404632 Sep 07 13:04:02.578806 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Sep 7 13:04:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:03.814940 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:03.815950 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 07 13:04:03.816347 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:04.343847 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-10ea51e1-2775-4f10-809b-ef90d959354b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:04.363230 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-10ea51e1-2775-4f10-809b-ef90d959354b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.409962 Sep 07 13:04:04.363773 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Sep 7 13:04:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:05.688821 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:05.689834 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 07 13:04:05.690261 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:06.222213 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-70a0e94c-892a-4285-b6a2-4334bc03820e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:06.241423 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-70a0e94c-892a-4285-b6a2-4334bc03820e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.412690 Sep 07 13:04:06.241905 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Sep 7 13:04:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:04:07.461062 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:07.462021 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 07 13:04:07.462452 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:07.983515 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-dbaf1366-d4b1-4281-999b-391a2340b604 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:08.004610 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-dbaf1366-d4b1-4281-999b-391a2340b604 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405191 Sep 07 13:04:08.005160 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Sep 7 13:04:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:05:05.619616 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:05.620640 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-230e4f0d-f8e3-4364-b6ee-d5eb5a518679 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Sep 07 13:05:05.621055 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Sep 7 13:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:05.631398 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:06.015604 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-bab8131a-ba48-4139-a6fa-e5bacb910515 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.037093 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-bab8131a-ba48-4139-a6fa-e5bacb910515 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410117 Sep 07 13:05:06.037636 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Sep 7 13:05:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:05:06.058582 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG dbcounter [-] [105633] Writing DB stats nova_api:SELECT=14 {{(pid=105633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:06.062775 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-17a95e1e-933e-411c-ad59-20a11432e647 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.071099 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-17a95e1e-933e-411c-ad59-20a11432e647 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013292 Sep 07 13:05:06.071608 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Sep 7 13:05:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:06.083157 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-17ff7ba1-cca8-488b-ba1c-dbcb51260c6d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.090796 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-17ff7ba1-cca8-488b-ba1c-dbcb51260c6d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011217 Sep 07 13:05:06.091304 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Sep 7 13:05:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:06.102508 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.110065 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011133 Sep 07 13:05:06.110627 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Sep 7 13:05:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:06.122114 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-0bf937c9-e451-477a-8edd-755e29f59d4d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.129608 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-0bf937c9-e451-477a-8edd-755e29f59d4d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010928 Sep 07 13:05:06.130108 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Sep 7 13:05:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:16.924410 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:16.925450 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 07 13:08:16.925845 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:17.081227 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=6 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:17.244359 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.247833 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.248340 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.248767 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.249482 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.249927 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.250342 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.297312 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-9f7b56f9-5b4e-4cf7-a32c-0cf72cf68bbc admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.217553 Sep 07 13:08:17.297894 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:08:18.391687 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:18.392700 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 07 13:08:18.393102 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:18.585347 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:18.588809 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.589322 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.589796 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.590563 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:18.591010 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:18.591425 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:18.611273 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-ef47b24c-0d08-4579-bcf1-e9908b762446 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077453 Sep 07 13:08:18.611821 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:30.126097 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.127257 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 07 13:08:30.127928 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:30.271862 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:30.272621 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:30.273400 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=8 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:30.322796 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:30.326216 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.326736 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.327200 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.327990 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:30.328458 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:30.328900 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:30.349786 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4937b715-f34e-4601-8c8e-f174f4c97f6b admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.082338 Sep 07 13:08:30.350891 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:31.449489 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:31.450517 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 07 13:08:31.450917 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:31.645019 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:31.648691 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.649168 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.649599 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.650345 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:31.650822 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:31.651240 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:31.671373 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-3ac7f6ea-55d1-4a5a-8666-c31c6c502e5a admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078701 Sep 07 13:08:31.672191 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:31 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:08:43.173740 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:43.174800 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 07 13:08:43.175204 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 38/77] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:43.322742 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:43.323451 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:43.324476 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=8 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:43.372472 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:43.375834 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.376317 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.376749 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.377461 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:43.377909 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:43.378327 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:43.403800 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-b1db8cc5-75f5-402a-932c-0decd87bb359 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085785 Sep 07 13:08:43.404361 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 40/78] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:43 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:08:44.481674 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: DEBUG nova.api.openstack.wsgi [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] Calling method '>' {{(pid=105633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:44.482755 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: INFO nova.api.openstack.requestlog [None req-92340ae4-3ff8-4a68-8ad9-d17189b52fb2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 07 13:08:44.483164 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: [pid: 105633|app: 0|req: 39/79] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Sep 7 13:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:44.672135 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:44.675518 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:44.675982 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:44.676437 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.677123 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:44.677558 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:44.677966 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:44.699553 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a4fe1da0-1efd-4936-a348-159748a93f6a admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.078892 Sep 07 13:08:44.700092 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 41/80] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Sep 7 13:08:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:09:51.996845 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: Wed Sep 7 13:09:51 2022 - graceful shutdown triggered... Sep 07 13:09:51.996969 dv-cinder-790535-42-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 13:09:51.997994 dv-cinder-790535-42-iscsi devstack@n-api.service[105633]: Gracefully killing worker 1 (pid: 105633)... Sep 07 13:09:51.998472 dv-cinder-790535-42-iscsi devstack@n-api.service[105634]: Gracefully killing worker 2 (pid: 105634)... Sep 07 13:09:52.998560 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: worker 1 buried after 1 seconds Sep 07 13:09:52.999148 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: worker 2 buried after 1 seconds Sep 07 13:09:52.999148 dv-cinder-790535-42-iscsi devstack@n-api.service[105632]: goodbye to uWSGI. Sep 07 13:09:53.000897 dv-cinder-790535-42-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 13:09:53.001474 dv-cinder-790535-42-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 13:09:53.004256 dv-cinder-790535-42-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 13:09:53.013888 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 13:09:53 2022] *** Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: nodename: dv-cinder-790535-42-iscsi Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: machine: x86_64 Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: clock source: unix Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: pcre jit disabled Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: detected number of CPU cores: 4 Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: current working directory: / Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: detected binary path: /usr/bin/uwsgi-core Sep 07 13:09:53.015884 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: your processes number limit is 47680 Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: your memory page size is 4096 bytes Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: detected max file descriptor number: 2048 Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: lock engine: pthread robust mutexes Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: thunder lock: enabled Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 13:09:53.016634 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 13:09:53.056835 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: Python main interpreter initialized at 0x5647381279c0 Sep 07 13:09:53.056835 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: python threads support enabled Sep 07 13:09:53.056835 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: your server socket listen backlog is limited to 100 connections Sep 07 13:09:53.056835 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: your mercy for graceful operations on workers is 90 seconds Sep 07 13:09:53.057254 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 13:09:53.057254 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: *** Operational MODE: preforking *** Sep 07 13:09:53.057569 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: *** uWSGI is running in multiple interpreter mode *** Sep 07 13:09:53.057569 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: spawned uWSGI master process (pid: 120718) Sep 07 13:09:53.057794 dv-cinder-790535-42-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 13:09:53.058835 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: spawned uWSGI worker 1 (pid: 120737, cores: 1) Sep 07 13:09:53.069820 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: spawned uWSGI worker 2 (pid: 120738, cores: 1) Sep 07 13:09:53.069820 dv-cinder-790535-42-iscsi devstack@n-api.service[120718]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 13:09:53.734853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:09:53.735455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 13:09:54.917649 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:09:54.917649 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: from cryptography.utils import int_from_bytes Sep 07 13:09:54.918580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:09:54.918580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: from cryptography.utils import int_from_bytes Sep 07 13:09:54.918754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:09:54.918754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: from cryptography.utils import int_from_bytes Sep 07 13:09:54.919167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 13:09:54.919167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: from cryptography.utils import int_from_bytes Sep 07 13:09:57.364023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:09:57.365233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:09:57.365233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:09:57.365233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:09:57.365469 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:09:57.365786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.366120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.366468 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.366798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.367193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.367573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.368021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.368343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.368839 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.369252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.369711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.370349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-42-iscsi {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.370886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.371205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.371527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.371853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.372167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.372497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.372809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.373323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.373759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.374074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.374392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.375330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.375661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.375945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.376273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.376587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.376918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.377233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.377642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-42-iscsi {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.377968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.378289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.378646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.379081 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.379194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 13:09:57.379579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.379668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 13:09:57.379750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.379947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 13:09:57.380059 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.380314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 13:09:57.380446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.380643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 13:09:57.380753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.380941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.381907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.382968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383186 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383493 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.383868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384355 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-42-iscsi {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.384862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385625 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385829 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.385941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.386910 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.387947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.388907 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.389945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.390233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.390333 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.390574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.390671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.390987 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-42-iscsi {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.391933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392404 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.392895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.393050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.393222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.393383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.393730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394127 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.394762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.395936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.396008 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.396211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.396314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.396521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.396611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.398578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.398813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.398927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.399930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400245 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400560 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.400958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.401061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.401486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.401654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.401807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.401964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.402908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.403967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404124 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.404888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.405875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.406197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.406361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.406584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.406736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.406893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.407052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.407200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.407360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.407516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.407672 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408532 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.408975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.409908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410069 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.410882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411359 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411654 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.411957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.412887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.413049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.413207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.413356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.413516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.413686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.413924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.414091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.414253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.414403 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.414586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.414736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.414892 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.415049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.415198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.415346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.415500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.415657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.415833 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.416536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.416699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.416871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.417029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.417187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.417336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.417492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.417639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.417856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.418007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.418154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.418309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.418745 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.418900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.419083 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.419234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.419390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.419540 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.419687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.419853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.420014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.420172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.420329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.420478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.420626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.420782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.420931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.421097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.421246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.421246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.422109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.422277 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.422480 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.422677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.422838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.422997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.423154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.423317 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.423484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.423637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.423804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.423978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.424233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.424387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.424535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.424691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.424841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.424841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.425165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.425361 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.425528 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.425686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.425845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.426015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.426171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.426334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.426593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.426745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.426905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.427061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.427256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 13:09:57.427424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.427581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.427736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.427895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.428967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.429886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.430838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431162 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.431939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432410 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.432879 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.433964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.434122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.434382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.434586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.434751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.434909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435277 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435590 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.435908 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.436859 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.437103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.437836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.438980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439296 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439454 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.439949 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440116 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.440871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441504 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441829 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.441979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442134 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.442974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.443891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.444921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445236 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.445863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.446898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.447821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.448927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.449866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.450858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451046 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.451843 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452649 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.452961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.453910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454223 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.454984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455451 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.455915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456535 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.456845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.457928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.458883 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.459973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460654 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.460960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.461893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.462985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.463143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.463313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.463313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.464166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.464328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.464485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.464637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.464800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465059 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.465841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.466184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.466348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.466578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.466742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.466902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.467985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468474 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.468954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.469873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470522 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.470997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471473 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471629 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.471943 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.472894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.473956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.474122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.474283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.474537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.474711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.474878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.475970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476297 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.476919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.477949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478449 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.478965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479464 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479464 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.479921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480090 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480554 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.480888 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481065 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.481871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.482855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.483017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.483193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.483364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.483532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.483689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.484358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.484530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.484694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.484871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485765 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.485948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486269 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486651 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.486988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487802 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.487967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488777 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.488933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.489877 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.490868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.491991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.492935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493395 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.493705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.494984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.495148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.495312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.495469 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.495655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.495915 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496415 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.496890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.497981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.498980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.499144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.499308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.499497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.499721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.499891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.500048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.500210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.500210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.500527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.501260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.501422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.501584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.501740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.501902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.502905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503419 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.503903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.504862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.505853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.506998 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.507950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.508971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509137 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.509943 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510605 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.510771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.511903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.512869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.513024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.515798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.515969 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.516173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.516453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.516635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.516792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.516947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517580 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.517899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518381 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.518909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.519933 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.520919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521084 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.521878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.522918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523088 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523417 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.523746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.524875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.525986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.526142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.526296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.526503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.526757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.526932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527410 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.527901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.528858 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529013 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529341 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.529837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.530000 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.530157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.530321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.530510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.530683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.531388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.531554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.531720 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.531887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.532868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.533824 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.534995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535794 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.535965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.536131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.536286 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.536447 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.536603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.536791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.537857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.538852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539010 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539172 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.539818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.540996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.541954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542625 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.542767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.543996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.544936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545095 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545902 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.545978 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.546058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.546133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.546206 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.546279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.546447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547651 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.547964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.548955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549114 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.549900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.550782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.551527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.551686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.551686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.551988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552812 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.552975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553146 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553304 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553794 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.553958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.554263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.554263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.554683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.554852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.555988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556298 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556458 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.556962 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.557119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.557119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.557420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.557690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.557860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558526 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.558867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.559852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.560976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.561965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.562236 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.562488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.562666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.562835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.562992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563317 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.563947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.564917 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565079 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.565875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.566038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.566275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.566530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.566704 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.566862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.567948 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568511 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.568840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569152 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569152 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.569801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.570106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.570106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.570452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.570695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.570856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.571845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572338 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.572990 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.573979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.574977 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.575945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576593 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.576901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577540 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.577905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.578171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.578346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.578582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.578582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.578888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579678 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.579838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580816 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.580971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581608 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.581916 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.582942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583568 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.583887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.584699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.585970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.586144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.586301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.586598 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.586779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.586945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587266 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.587764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.588965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.589904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.590870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.591995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592674 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592674 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.592985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.593141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.593886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594565 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.594732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.595063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.595063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.595360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.595515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.595515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596652 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.596983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.597138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.597303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.597458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.597614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.598384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.598705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.598877 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.599853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.600954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.601972 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602498 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602833 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.602997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.603292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.603446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.603614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.603770 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.603937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604601 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.604958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.605178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.605340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.605537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.605695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.605858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606720 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.606877 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.607844 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.608007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.608172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.608348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.608526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.608804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.609606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.609845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610042 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.610870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611824 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.611980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612312 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.612947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613849 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.613942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.614929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615421 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.615974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616262 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616816 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.616999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617376 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617829 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.617917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618367 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.618844 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619072 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619512 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.619944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620300 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.620935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621231 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621645 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.621923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622008 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622489 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.622924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623268 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623448 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.623863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624142 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624409 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624693 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.624974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625415 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.625967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626617 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626898 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.626986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.627975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628654 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.628928 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629298 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.629949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630046 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630223 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.630933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.631935 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632276 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632495 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.632911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.633129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.633233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.633378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:09:57.633484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.633759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.634078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.634429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.634759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.635087 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.635521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.635870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.636193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.636513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.636835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.637155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.637474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.637792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.638131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.638507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.638806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.639138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.639465 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.639799 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.640206 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.640589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.640940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.641758 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.641898 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.642214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.642613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.642939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.643266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.643584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.643903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.644229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.644552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.644887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.645218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.645695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.646037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.646371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.646761 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.648386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.648761 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.649113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.649451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.649784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.650107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 13:09:57.650363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 13:09:57.706530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Registered counter for database nova_api Sep 07 13:09:57.715509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO dbcounter [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Registered counter for database nova_api Sep 07 13:09:57.728046 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.734347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.735833 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_db.sqlalchemy.engines [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.742652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writer thread running {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.791054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.context [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4c90cff-9714-42a7-a691-82968d71f0dc(cell1) {{(pid=120738) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:09:57.795360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.795842 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.797982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.798820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.799263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.800587 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.context [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4c90cff-9714-42a7-a691-82968d71f0dc(cell1) {{(pid=120737) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 13:09:57.801198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.803237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Registered counter for database nova_cell0 Sep 07 13:09:57.804626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.805102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.806704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.807280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Registered counter for database nova_cell1 Sep 07 13:09:57.807433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:57.807884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:57.809883 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:57.812555 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO dbcounter [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Registered counter for database nova_cell0 Sep 07 13:09:57.818517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO dbcounter [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Registered counter for database nova_cell1 Sep 07 13:09:57.818724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.820222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.824013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_db.sqlalchemy.engines [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.824170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.826033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_db.sqlalchemy.engines [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.832897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writer thread running {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.834193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writer thread running {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.963497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.975227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Registered counter for database nova_cell0 Sep 07 13:09:57.980884 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.985060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO dbcounter [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Registered counter for database nova_cell0 Sep 07 13:09:57.986600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:57.992047 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_db.sqlalchemy.engines [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 13:09:57.997108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writer thread running {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 13:09:58.327078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: WARNING keystonemiddleware.auth_token [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:09:58.329950 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:09:58.334439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: WARNING keystonemiddleware.auth_token [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:09:58.337204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:09:58.685065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: WARNING keystonemiddleware.auth_token [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:09:58.687009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 13:09:58.691248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: WARNING keystonemiddleware.auth_token [None req-dfeace3a-e880-4169-a968-7fb77f1f947e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:09:58.693067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-21307c6c-d07c-40ca-b4d5-37c1aa402000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 13:09:58.696550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647381279c0 pid: 120737 (default app) Sep 07 13:09:58.698295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647381279c0 pid: 120738 (default app) Sep 07 13:10:35.124782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.125461 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.126516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.128245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.603479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.604347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.605147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:35.607531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:36.577368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8426ec32-6f38-403d-aac1-5972504a6f6f tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Action: 'create', calling method: .version_select at 0x7f7f2c70f3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-559941205", "metadata": {"Type": "work"}}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:37.041344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7242c8a4-7b42-4141-a38e-8aeb241082ae tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Action: 'create', calling method: .version_select at 0x7f7f2c7103a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2027044006", "metadata": {"Type": "work"}}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7242c8a4-7b42-4141-a38e-8aeb241082ae tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 122 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:37.051033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2027044006", "metadata": {"Type": "work"}}} Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:37.052718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2027044006', 'metadata': {'Type': 'work'}}}} Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:37.053730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:10:37.055464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:10:37.056831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 13:10:37.056831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.063282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7242c8a4-7b42-4141-a38e-8aeb241082ae tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:37.067374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7242c8a4-7b42-4141-a38e-8aeb241082ae tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.468121 Sep 07 13:10:37.072387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Sep 7 13:10:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:10:37.085122 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ea938eb4-5bdf-49c2-945a-17a87d371974 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Action: 'create', calling method: .version_select at 0x7f7f2c710ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1774566120", "metadata": {"Type": "work"}}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ea938eb4-5bdf-49c2-945a-17a87d371974 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 120 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:37.092243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1774566120", "metadata": {"Type": "work"}}} Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:37.095721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1774566120', 'metadata': {'Type': 'work'}}}} Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi '0' Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:37.097020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:10:37.099107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:10:37.100520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 13:10:37.100520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.103845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ea938eb4-5bdf-49c2-945a-17a87d371974 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:37.105555 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ea938eb4-5bdf-49c2-945a-17a87d371974 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027703 Sep 07 13:10:37.107342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 2/2] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Sep 7 13:10:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:10:37.125989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2b8b75bd-b2f5-45f3-8178-a6827fe2c4be tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Action: 'create', calling method: .version_select at 0x7f7f2c5c90d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1003144569", "metadata": {"Type": "work"}}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2b8b75bd-b2f5-45f3-8178-a6827fe2c4be tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 119 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:37.136434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1003144569", "metadata": {"Type": "work"}}} Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:37.138143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1003144569', 'metadata': {'Type': 'work'}}}} Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi '' Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:37.139149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:10:37.140799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:10:37.142365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 13:10:37.142365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:37.145988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2b8b75bd-b2f5-45f3-8178-a6827fe2c4be tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:37.148242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2b8b75bd-b2f5-45f3-8178-a6827fe2c4be tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032284 Sep 07 13:10:37.151596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 3/3] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Sep 7 13:10:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:10:37.165054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-58779782-45b7-4e01-8698-f0a8bb0db407 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Calling method '.version_select at 0x7f7f2c5c9af0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-58779782-45b7-4e01-8698-f0a8bb0db407 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] HTTP exception thrown: Volume tempest-invalid-464490688 could not be found. Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-58779782-45b7-4e01-8698-f0a8bb0db407 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-464490688 HTTP/1.1 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:38.192149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Volume tempest-invalid-464490688 could not be found. Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'tempest-invalid-464490688'} Sep 07 13:10:38.195657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-464490688 could not be found. (HTTP 404) (Request-ID: req-aa09f645-1e4f-4ee1-bc2a-301351528937) Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.199832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:10:38.202111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-464490688 could not be found. Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:38.203680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-464490688 could not be found. Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-464490688 could not be found. Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-58779782-45b7-4e01-8698-f0a8bb0db407 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 404 to user: Volume tempest-invalid-464490688 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-58779782-45b7-4e01-8698-f0a8bb0db407 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-464490688" status: 404 len: 98 microversion: 2.1 time: 1.019530 Sep 07 13:10:38.208296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 4/4] 10.222.0.65 () {58 vars in 1215 bytes} [Wed Sep 7 13:10:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-464490688 => generated 98 bytes in 1032 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:10:38.210110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d07ba672-0735-423a-b8cb-818fc5fb97d0 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008401 Sep 07 13:10:38.210110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 5/5] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Sep 7 13:10:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 13:10:38.219941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5da9802a-f0e6-4c93-a34f-24c22b02c57b tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009097 Sep 07 13:10:38.231726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 6/6] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Sep 7 13:10:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 13:10:38.255481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03ad6341-a2a3-4ad0-92ac-92e340a8cceb tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Calling method '.version_select at 0x7f7f2c551dc0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-03ad6341-a2a3-4ad0-92ac-92e340a8cceb tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] HTTP exception thrown: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03ad6341-a2a3-4ad0-92ac-92e340a8cceb tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/os-volumes/fb00ea60-18d6-4a6b-9d0d-feaafa248b93 HTTP/1.1 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:38.526644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'fb00ea60-18d6-4a6b-9d0d-feaafa248b93'} Sep 07 13:10:38.529771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. (HTTP 404) (Request-ID: req-641d1366-d718-4be3-bea4-9f89e6dd41b2) Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:10:38.537064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:10:38.539025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03ad6341-a2a3-4ad0-92ac-92e340a8cceb tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 404 to user: Volume fb00ea60-18d6-4a6b-9d0d-feaafa248b93 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03ad6341-a2a3-4ad0-92ac-92e340a8cceb tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/fb00ea60-18d6-4a6b-9d0d-feaafa248b93" status: 404 len: 109 microversion: 2.1 time: 0.263186 Sep 07 13:10:38.545809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 7/7] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:10:38 2022] DELETE /compute/v2.1/os-volumes/fb00ea60-18d6-4a6b-9d0d-feaafa248b93 => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:38.546808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c3d78145-b797-4b20-8aec-4a2214174a11 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Calling method '.version_select at 0x7f7f2c4fb550>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:38.663223 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8426ec32-6f38-403d-aac1-5972504a6f6f tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.555199 Sep 07 13:10:38.664256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 1/8] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Sep 7 13:10:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3558 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:10:38.682330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a63d381-5876-450f-bdf2-653c86e405cc tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c5f2280>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:38.694172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-c3d78145-b797-4b20-8aec-4a2214174a11 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] HTTP exception thrown: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c3d78145-b797-4b20-8aec-4a2214174a11 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Request method failure captured: Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-volumes/0325642e-3b96-4850-8d52-2f6288f4feca HTTP/1.1 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhLm03YYwsB9PhRsn20UD55sGfHLBF9Zg5Ja-9CtPIjTFfjueJhlQRR6jFJ4UCyongGEu6aoZBXC3wHk_HbIKBT5TLkOJWkEAbjUVF5KooymI_RnfQ3tOGRdvhYW2eYaX9FZTkoNDZyJ2m_GLjhcz9pP9CVCsEL-2Kc1OwoEi0QV1k Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:10:38.697362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0321573f9f1e4db18134d6476627e6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0321573f9f1e4db18134d6476627e6c7 Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-178477231 Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: fa3fb9b936d74615b34e50cefa71dfe2 Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-178477231-project Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '0325642e-3b96-4850-8d52-2f6288f4feca'} Sep 07 13:10:38.698445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. (HTTP 404) (Request-ID: req-8b03974a-ecec-4816-8d2d-7187bbba1faa) Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.699040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:10:38.700035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:10:38.700868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c3d78145-b797-4b20-8aec-4a2214174a11 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] Returning 404 to user: Volume 0325642e-3b96-4850-8d52-2f6288f4feca could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:38.701690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c3d78145-b797-4b20-8aec-4a2214174a11 tempest-VolumesNegativeTest-178477231 tempest-VolumesNegativeTest-178477231-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0325642e-3b96-4850-8d52-2f6288f4feca" status: 404 len: 109 microversion: 2.1 time: 0.192187 Sep 07 13:10:38.710886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 8/9] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:38 2022] GET /compute/v2.1/os-volumes/0325642e-3b96-4850-8d52-2f6288f4feca => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:38.825747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4a63d381-5876-450f-bdf2-653c86e405cc tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 200 len: 352 microversion: 2.1 time: 0.147738 Sep 07 13:10:38.826818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 2/10] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:38 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:39.844112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-103a9c0b-155c-44b9-b8d5-9db8131655fa tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c551b80>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:39.990613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-103a9c0b-155c-44b9-b8d5-9db8131655fa tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 200 len: 352 microversion: 2.1 time: 0.152862 Sep 07 13:10:39.992409 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 9/11] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:39 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:41.010117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d2cb1577-81e0-40fc-be0c-2cc16a592c27 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c5f2940>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.121414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d2cb1577-81e0-40fc-be0c-2cc16a592c27 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 200 len: 353 microversion: 2.1 time: 0.119631 Sep 07 13:10:41.122067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 3/12] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:41 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:41.136321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-01eb74a5-b890-4b06-a35e-9bfeaed9a63d tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c4fb430>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.309364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-01eb74a5-b890-4b06-a35e-9bfeaed9a63d tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 200 len: 353 microversion: 2.1 time: 0.176975 Sep 07 13:10:41.311284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 10/13] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:41 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:41.338903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0ad0ad7f-3ec1-4fd9-a2e3-eed4bf38e044 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c57b040>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.488979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0ad0ad7f-3ec1-4fd9-a2e3-eed4bf38e044 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 202 len: 0 microversion: 2.1 time: 0.158198 Sep 07 13:10:41.490914 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 4/14] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:10:41 2022] DELETE /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:10:41.499292 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0162a83e-8da9-4429-9bde-df52837c86b2 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c509040>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:41.585829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0162a83e-8da9-4429-9bde-df52837c86b2 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 200 len: 352 microversion: 2.1 time: 0.091584 Sep 07 13:10:41.586398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 11/15] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:41 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:10:42.603173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b4157c4b-cbbb-4af5-b0dd-4a5310242000 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Calling method '.version_select at 0x7f7f2c57b1f0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:42.672474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-b4157c4b-cbbb-4af5-b0dd-4a5310242000 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] HTTP exception thrown: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b4157c4b-cbbb-4af5-b0dd-4a5310242000 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Request method failure captured: Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 HTTP/1.1 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhLEccf8LOoXrD3wmvCDuhPsZ-4toSfAKqOgNwkRWyN6FgdD9qZ1TIfwU7ScBFPmjjtXwezALmu8AnOk90J4OcfTp_fVdNwh2wDnXpL2dAqvsPsCk0FPV7JGjgZy5Lr80aRpFFel0CCeQo22ppH13a2rtsxZhDs9_fjMcDqygX8DCU Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 3a4c069060174d46b92b8a514d507457 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesGetTestJSON-1712633558 Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:10:42.677896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3a4c069060174d46b92b8a514d507457"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3a4c069060174d46b92b8a514d507457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3a4c069060174d46b92b8a514d507457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3a4c069060174d46b92b8a514d507457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesGetTestJSON-1712633558 Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 3a4c069060174d46b92b8a514d507457 Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesGetTestJSON-1712633558 Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesGetTestJSON-1712633558-project Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 25197cffadb9404ab5383c55fecd8095 Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesGetTestJSON-1712633558-project Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'ad613809-ea2c-48b0-90d9-73a30fda9162'} Sep 07 13:10:42.679176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. (HTTP 404) (Request-ID: req-1669a5e2-820c-429e-be21-f7b4aff47395) Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:42.679864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:10:42.680828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:10:42.681767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. Sep 07 13:10:42.682760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:10:42.691800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b4157c4b-cbbb-4af5-b0dd-4a5310242000 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] Returning 404 to user: Volume ad613809-ea2c-48b0-90d9-73a30fda9162 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:42.696394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b4157c4b-cbbb-4af5-b0dd-4a5310242000 tempest-VolumesGetTestJSON-1712633558 tempest-VolumesGetTestJSON-1712633558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162" status: 404 len: 109 microversion: 2.1 time: 0.097691 Sep 07 13:10:42.699515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 5/16] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:10:42 2022] GET /compute/v2.1/os-volumes/ad613809-ea2c-48b0-90d9-73a30fda9162 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:51.760989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-736479635", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:52.077431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] validate_networks() for [('ec0a542c-452b-4ff5-aa20-9ab6380517c3', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:10:53.802641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-111556f7-7d4b-4541-b931-b8932f9e260d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: .version_select at 0x7f7f2cf3ea60>, body: {"keypair": {"name": "tempest-keypair-1923755522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvThuksGTHPw1gUKzTwfj3dEQoJP6TU1PFSwwZXAIb9GfwVvn6U5wYZ7f1I5bkniLrWvypUcHhBybJXu1ZdqlHk7odzoX1Qn7Ljhi8FnqkjPMbgEUBoxxE+tnSO3E0KBg=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:53.967547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-111556f7-7d4b-4541-b931-b8932f9e260d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for project c3738db936ec4845ac4ac33f78816fb1. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:10:53.992231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-111556f7-7d4b-4541-b931-b8932f9e260d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for user 458eb2f4b67541a69e30b238c7d2a78b and project c3738db936ec4845ac4ac33f78816fb1. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:10:54.097063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-111556f7-7d4b-4541-b931-b8932f9e260d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.981242 Sep 07 13:10:54.098461 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 6/17] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:10:55.970288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:10:55.970856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:10:55.971249 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:10:55.971653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:10:55.972159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:10:55.989640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.990640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.991237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:55.992111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:55.992699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:55.993432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:56.073262 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:10:56.089837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for user d5a9fcebd3164b59893658ad92dfcafb and project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:10:56.120435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:10:56.132576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:10:56.318121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f2adae7e-6cd6-45d8-ac1b-fbb04dd0cb2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.903757 Sep 07 13:10:56.321433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 12/18] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:10:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 4908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:10:56.334893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-65068656-c1e0-4692-8110-dd5239a38edc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:56.335667 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-65068656-c1e0-4692-8110-dd5239a38edc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:56.565428 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-65068656-c1e0-4692-8110-dd5239a38edc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:10:56.614440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-65068656-c1e0-4692-8110-dd5239a38edc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1221 microversion: 2.1 time: 0.282283 Sep 07 13:10:56.616871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 7/19] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:56 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1221 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:10:56.977966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d730fb32-033c-414b-a073-ee13664ef9bc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: .version_select at 0x7f7f2bc065e0>, body: {"keypair": {"name": "tempest-keypair-983455319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu4FfMNVyu9mnyAz7SI1TQeRn1PopyjB2eMyyGblQBc4D7umFzM5N/6dTAlT9MA2/FQclzqaPFLVfs288ot1TgO7Wa/DxNXQBpG3dV0LdS8sV88MQGL+FxwWUwDnc1Vag=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:57.017979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d730fb32-033c-414b-a073-ee13664ef9bc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:10:57.024214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d730fb32-033c-414b-a073-ee13664ef9bc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:10:57.122591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d730fb32-033c-414b-a073-ee13664ef9bc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.734781 Sep 07 13:10:57.135371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 13/20] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:10:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:10:57.485498 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-353134013", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:57.764085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] validate_networks() for [('ec0a542c-452b-4ff5-aa20-9ab6380517c3', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:10:59.446525 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1035008453", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "networks": [{"uuid": "38ef8aa4-790a-495d-8da2-cf3db92626d6"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:59.580686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] validate_networks() for [('38ef8aa4-790a-495d-8da2-cf3db92626d6', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:11:01.418329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:11:01.423739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:11:01.424135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:11:01.424564 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:11:01.425109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:11:01.456051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.456631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.457186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.465755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:01.466281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:01.468336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:01.501058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Getting quotas for project 51dd65c7d44b4858b2194baea7541d45. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:11:01.506295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Getting quotas for user 88f2768629fa4e4e86dfea42f4cf674c and project 51dd65c7d44b4858b2194baea7541d45. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:11:01.529096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:11:01.532979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:11:01.650146 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c01bfdfc-1605-4f25-a6b8-3454d6bbadeb tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.158500 Sep 07 13:11:01.650933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 14/21] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:11:01.669440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62f927bb-acb1-4f87-911f-4d8603c68809 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:01.670089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62f927bb-acb1-4f87-911f-4d8603c68809 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:02.041378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62f927bb-acb1-4f87-911f-4d8603c68809 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:02.097154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62f927bb-acb1-4f87-911f-4d8603c68809 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1215 microversion: 2.1 time: 0.434497 Sep 07 13:11:02.099220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 15/22] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:01 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1215 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:02.140250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-133752976", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45cf53b7-1bc3-49c2-b27f-b303adbc949b"}], "security_groups": [{"name": "tempest-securitygroup--974497857"}], "key_name": "tempest-keypair-1923755522", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:02.152161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:11:02.152814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:11:02.153577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:11:02.154140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:11:02.154688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:11:02.176287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.178748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.181463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.182754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:02.185801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:02.186719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:02.307694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:11:02.326070 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for user d5a9fcebd3164b59893658ad92dfcafb and project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:11:02.360990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:11:02.369708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:11:02.578874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c67766dc-ea29-407e-8f88-d3cb34cfa272 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.100983 Sep 07 13:11:02.587229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 8/23] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:10:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 5110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:11:02.613061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e2e03c70-f7a5-4e68-8b40-099b3bbbb528 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:02.616193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e2e03c70-f7a5-4e68-8b40-099b3bbbb528 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:02.947018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e2e03c70-f7a5-4e68-8b40-099b3bbbb528 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:02.955329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e2e03c70-f7a5-4e68-8b40-099b3bbbb528 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1221 microversion: 2.1 time: 0.361728 Sep 07 13:11:02.960322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 9/24] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:02 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1221 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:03.116384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] validate_networks() for [('45cf53b7-1bc3-49c2-b27f-b303adbc949b', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:11:03.126036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5810a8e2-a0b5-4139-810f-4a218ada306b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:03.126695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5810a8e2-a0b5-4139-810f-4a218ada306b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:04.159251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5810a8e2-a0b5-4139-810f-4a218ada306b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:04.171340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5810a8e2-a0b5-4139-810f-4a218ada306b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1215 microversion: 2.1 time: 1.049934 Sep 07 13:11:04.225769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 10/25] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:03 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1215 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:04.247757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:04.248405 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:04.289466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.289992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.290466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:04.306838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:04.307587 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:04.312249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.399346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:05.457898 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-76343f59-e06d-40ae-9de2-fedc7509ef2e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1217 microversion: 2.1 time: 1.222159 Sep 07 13:11:05.462398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 11/26] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:04 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1217 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:05.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:05.477012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:05.502463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.507165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.509356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.510360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:05.516965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:05.520302 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:05.679876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:05.689259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5e698341-f55b-4930-95f9-886fdea21bb4 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1211 microversion: 2.1 time: 0.222215 Sep 07 13:11:05.690252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 12/27] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:05 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1211 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:06.116006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:11:06.117736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:11:06.118464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:11:06.119131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:11:06.119766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:11:06.144359 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.146401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.147226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.148848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.150725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.151397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.199351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for project c3738db936ec4845ac4ac33f78816fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:11:06.221273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for user 458eb2f4b67541a69e30b238c7d2a78b and project c3738db936ec4845ac4ac33f78816fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:11:06.237986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:11:06.241542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:11:06.348822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e07c3fa5-4798-4b46-8f77-da5c37f2449f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.216517 Sep 07 13:11:06.350185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 16/28] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:11:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 4218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:11:06.361074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a060261c-b4ce-486a-ab8c-15355509f8b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:06.361699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a060261c-b4ce-486a-ab8c-15355509f8b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:06.485638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:06.486504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:06.498192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.499574 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.501712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.506498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.509617 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.511417 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.536401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a060261c-b4ce-486a-ab8c-15355509f8b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:06.553928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a060261c-b4ce-486a-ab8c-15355509f8b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1237 microversion: 2.1 time: 0.186632 Sep 07 13:11:06.553928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 13/29] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:06 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:06.721344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:06.721834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:06.736644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.758343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.759322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.772108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:06.772637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:06.773083 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:06.986454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:07.020521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b79a48fd-5877-4f0c-88c3-5edc797fc8c7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1211 microversion: 2.1 time: 0.300439 Sep 07 13:11:07.024474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 14/30] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:06 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1211 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:07.244799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:07.308926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5be00978-05bc-4bfb-bd1d-7fafc60756bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1281 microversion: 2.1 time: 0.827319 Sep 07 13:11:07.331153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 17/31] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:06 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1281 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:07.573093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:07.573932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:07.589576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.600298 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.604057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:07.609350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:07.619053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:07.621287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:08.047852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:08.048865 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:08.064985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:08.069645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:08.072380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:08.076314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:08.078189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:08.079145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:08.236185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.245394 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d16f51d1-80c0-4cb3-8d24-5f8402e438a8 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1267 microversion: 2.1 time: 0.201939 Sep 07 13:11:08.251837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 18/32] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:08 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:08.257646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.273680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f1a5db86-2924-4213-ab7a-b3c8696852b4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1241 microversion: 2.1 time: 0.703805 Sep 07 13:11:08.274265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:07 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1241 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:08.294069 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-661643726", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be10bb5-1b7b-48d3-b1b4-958b66e89a40"}], "security_groups": [{"name": "tempest-securitygroup--579616591"}], "key_name": "tempest-keypair-983455319", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:08.356436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:08.357486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:08.370048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:08.370727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:08.371405 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:08.372178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:08.372668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:08.373141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:08.562063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] validate_networks() for [('0be10bb5-1b7b-48d3-b1b4-958b66e89a40', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:11:08.563864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:08.574679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9353ed12-40b3-4cb8-9167-6127bce23aa3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1279 microversion: 2.1 time: 0.222814 Sep 07 13:11:08.575903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 16/34] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:08 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:09.284463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:09.285351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:09.299235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.299952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.302888 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.304314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.307123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.307819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.772092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:11:09.772909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:11:09.773554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:11:09.774140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:11:09.774951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:11:09.819532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.821598 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.822095 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.822948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.831636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.833653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.860580 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:09.877248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-36935698-ff88-4be9-bc53-52b79cd9302f tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1267 microversion: 2.1 time: 0.592902 Sep 07 13:11:09.881052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:09 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1267 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:09.906243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:09.917039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:09.918814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:11:09.939431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:11:09.944372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.945523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.967217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.970797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:09.971314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:09.974794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:09.999662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:11:10.002945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:11:10.246688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cd7f6ebf-5a72-413e-835c-c58d9a36db50 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.969376 Sep 07 13:11:10.256592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 19/36] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:11:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:11:10.300717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:10.305666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:10.350755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.350755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.351092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:10.359182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.359677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.360516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:10.531773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.539860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6f303114-10b5-4946-b0af-929cc92c053d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1289 microversion: 2.1 time: 0.657703 Sep 07 13:11:10.545341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 18/37] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:09 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1289 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:10.560299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-838b282c-13d0-4a51-ae2e-d8f44bb9f57d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:10.571331 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-838b282c-13d0-4a51-ae2e-d8f44bb9f57d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:10.625560 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.635400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f981800f-6705-4d09-99ff-b9b1be8df5a8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1279 microversion: 2.1 time: 0.377698 Sep 07 13:11:10.638642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 20/38] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:10 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1279 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:10.702764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-838b282c-13d0-4a51-ae2e-d8f44bb9f57d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:10.714755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-838b282c-13d0-4a51-ae2e-d8f44bb9f57d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1240 microversion: 2.1 time: 0.157491 Sep 07 13:11:10.716724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 19/39] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:10 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1240 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:10.912061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:10.913323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:10.933722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.934885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.935622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:10.936959 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:10.937591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:10.938194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:11.372795 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:11.396258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ae109a97-07e2-40e8-a4fd-59a2b7a5cef3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1273 microversion: 2.1 time: 0.482832 Sep 07 13:11:11.407378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 21/40] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:10 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:11.572715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:11.573779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:11.595868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:11.598909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:11.599769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:11.605711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:11.606442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:11.607023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.006396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148b91ad-ea95-4819-8a38-efc0917b5c10", "tag": "2600cb21-5d65-4406-b4b8-dfb49cee0aaf"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:12.037680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.038817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.039515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.080197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Creating event network-changed:2600cb21-5d65-4406-b4b8-dfb49cee0aaf for instance 148b91ad-ea95-4819-8a38-efc0917b5c10 on hv-cinder-79053 Sep 07 13:11:12.080969 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:11:12.081519 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-674769ee-0599-42a7-8520-8060970fc5d6 req-66b84beb-2652-47c1-bdee-efb9d698aab4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:11:12.083468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.084696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.085296 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.086214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.087840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.089043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.104807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.compute.rpcapi [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:11:12.106589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] Releasing lock "compute-rpcapi-router" {{(pid=120737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:11:12.146078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e5dfa4de-9f93-420b-a67f-bd179bb0417a None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.613482 Sep 07 13:11:12.147114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 20/41] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:12.164798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:12.167008 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:12.188151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.189126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.189921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.202362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.208817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.209661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.478007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:12.502830 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bac6364c-3f0a-4db1-80cb-9dd45e0026e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1279 microversion: 2.1 time: 0.345838 Sep 07 13:11:12.506020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 21/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:12 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1279 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:12.532650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:12.533313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:12.548480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.550194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.550908 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:12.552928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:12.553685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:12.554269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.305129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.315336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0678fc15-d6e4-48e0-b4b0-edf9de97307e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1289 microversion: 2.1 time: 1.748247 Sep 07 13:11:13.316538 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 22/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:11 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1289 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:13.336007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:13.336720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:13.369509 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.370123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.374811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.375832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.377153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.378477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.575795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.589230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-14f168e4-be06-4473-846f-783b96482dff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1292 microversion: 2.1 time: 1.077185 Sep 07 13:11:13.593595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 22/44] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:12 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1292 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:13.607912 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:13.608942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:13.646085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.655424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.656201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.659282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:13.661585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:13.664353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:13.824888 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:13.841109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f953477a-dc4e-4485-964a-5f2bbd158dbb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1279 microversion: 2.1 time: 0.246025 Sep 07 13:11:13.842874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 23/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:13 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:14.343803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.344350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:14.345009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:14.365936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4d260e21-cbd9-492b-a8ad-7305542594d1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 1.046080 Sep 07 13:11:14.367310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.370149 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.371838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.373868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.378155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.381080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.385280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 23/46] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:13 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:14.620804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:14.621430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:14.636454 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.636951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.637546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.638407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.639117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.639706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.789037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.809682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a1d5522f-bdbd-4dcf-b507-42e7999cee8c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1298 microversion: 2.1 time: 0.192770 Sep 07 13:11:14.814520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 24/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:14 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:14.868769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:14.869711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:14.885980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:14.888140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.891133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.893572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.897091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:14.897829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:14.898771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:14.906038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:14.936489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-da0281ee-b0f7-482a-b3f9-fbee6ec41dc5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1295 microversion: 2.1 time: 0.599545 Sep 07 13:11:14.937646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:14 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1295 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:15.324008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:15.351439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b47f815-48d1-43c3-bc12-11c5960f2cbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.482914 Sep 07 13:11:15.361105 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 25/49] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:14 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:15.400463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:15.402703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:15.430984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.431529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.431983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:15.448407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.452457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.454366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:15.843714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:15.844239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:15.851455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.851944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.852373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:15.853070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:15.853517 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:15.853940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:16.049654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.058584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-45905d01-e149-45fa-b22c-d31deb1218e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1298 microversion: 2.1 time: 0.218645 Sep 07 13:11:16.066746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 26/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:15 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:16.080035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:16.080658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:16.095473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:16.095957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:16.096398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:16.097091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:16.097537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:16.100398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:16.360500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.376068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-74b5fd7f-6e26-4e5a-a522-e848e996fc06 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1295 microversion: 2.1 time: 0.306642 Sep 07 13:11:16.378091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 27/51] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:16 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1295 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:16.397542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:16.398628 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:16.409687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:16.427040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:16.427874 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:16.428956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:16.430969 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:16.433045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:16.471397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:16.481142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-63c610b3-06b7-4853-bbba-927395705661 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 1.092453 Sep 07 13:11:16.503011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 25/52] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:15 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:17.094582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:17.095437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:17.113644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.117401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.118786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:17.131041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.132757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.133942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:17.331966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:17.342369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-684244f1-e450-4074-b066-463cce6bdb60 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.960580 Sep 07 13:11:17.345698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 28/53] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:16 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:17.411238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:17.411965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:17.448308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.454151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.456339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:17.458706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:17.462655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:17.470224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:18.339476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:18.384829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e20ae398-4fce-42a7-b6b0-6aebef909f8a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.974843 Sep 07 13:11:18.384829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 29/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:17 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:18.395150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:18.397162 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:18.443299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:18.443974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:18.444278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:18.458504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:18.460673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:18.464514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:18.986100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:18.996669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a3f43472-77ea-453e-93c9-8076a4b33125 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 1.915031 Sep 07 13:11:18.997258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 26/55] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:17 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:19.001735 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:19.002340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:19.024395 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:19.026232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:19.028663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:19.029398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:19.029868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:19.030308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:19.505768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:19.514803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f6f5c258-ac62-4ff9-ad93-f96592eac7de tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 1.132861 Sep 07 13:11:19.524657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 30/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:18 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:19.870167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e73559-759b-40c1-8e2c-fd583122c70c", "tag": "1c347cf4-9431-41d8-95e9-13c05eb48661"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:19.892443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:19.909499 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:19.910228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:19.912776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:19.998500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=30 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:20.007350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Creating event network-changed:1c347cf4-9431-41d8-95e9-13c05eb48661 for instance a5e73559-759b-40c1-8e2c-fd583122c70c on hv-cinder-79053 Sep 07 13:11:20.008218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 13:11:20.012310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e04073c9-54ec-41a8-9d57-543c0636df14 req-2ea4bb22-b35c-4a52-82cf-04ecd53fde29 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 13:11:20.015336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.016145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.017950 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.021714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.022442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.023042 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.058339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.compute.rpcapi [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 13:11:20.059335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] Releasing lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 13:11:20.109631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4f97a816-872f-4df1-aa3b-78ae9b5bb81e None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583475 Sep 07 13:11:20.110840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 31/57] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:20.117804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:20.119238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:20.128414 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.129097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.131319 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.132239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.133106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.135985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.154626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:20.182493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ff196ae3-8a5c-4b87-b526-c88c52df6e7d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 1.181252 Sep 07 13:11:20.183673 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 27/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:18 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:20.196891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:20.206942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:20.223455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.224535 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.224974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.225690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.226143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.226605 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.399734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:20.409572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7ecae0e8-1373-4de9-92c9-f10e0833394d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.297364 Sep 07 13:11:20.413184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 32/59] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:20 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:20.547948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:20.548611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:20.568798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.569548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.570679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.571561 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.572181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.572937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.616012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:20.675022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:20.684417 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5fe5dd17-c933-44a6-b0b0-ba31484301a6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.499491 Sep 07 13:11:20.685493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 28/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:20 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:20.690396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87baeec7-935c-4c71-87db-693080de3051", "tag": "7c9852da-200d-449a-93d7-10765318ac7b"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:20.702011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:20.702691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:20.703336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:20.716725 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=20 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:20.719862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] Creating event network-changed:7c9852da-200d-449a-93d7-10765318ac7b for instance 87baeec7-935c-4c71-87db-693080de3051 on hv-cinder-79053 Sep 07 13:11:20.728616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-aae4c476-b682-4a5b-ba79-fcc61bcf12bf req-c79ac8d0-27a1-442b-8e81-aaaf3d8f4d5e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041561 Sep 07 13:11:20.729443 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 29/61] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:21.004563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.014945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0f6e93c6-1aae-44db-8f14-d1296c44dcf3 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.470714 Sep 07 13:11:21.023168 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 33/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:20 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:21.207670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:21.210268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:21.217700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.218196 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.218660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.219530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.219993 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.220424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.225258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:21.364433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.372741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9a7f1def-f8c9-442a-a39c-fbaee8dff2f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.171325 Sep 07 13:11:21.373319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 30/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:21 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:21.435128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:21.435755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:21.441733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.442218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.442721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.443404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.443860 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.444286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.576698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.585236 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fa28938c-fa30-4227-a2b1-63a5ab0ac6bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.153894 Sep 07 13:11:21.585996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 34/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:21 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:21.711405 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:21.712016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:21.718180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.718713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.719154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.719839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:21.720345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:21.720735 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:21.850078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:21.857732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4fb52181-25c4-4ea4-93a6-9dbfdb72c629 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.150705 Sep 07 13:11:21.858300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 31/65] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:21 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:22.039119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:22.039735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:22.045572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.046071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.046519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.047205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.047652 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.048071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.159756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c", "tag": "6b808cc9-08ba-42d0-9e09-79b6c1566f01"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:22.165410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:22.171327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.171812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.172241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.184496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] Creating event network-changed:6b808cc9-08ba-42d0-9e09-79b6c1566f01 for instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c on hv-cinder-79053 Sep 07 13:11:22.185461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.189505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-2107ea72-7a4f-4e98-bb01-30afbbc42d85 req-cdb50332-ab52-4ae5-965b-51606c346499 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033449 Sep 07 13:11:22.193544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a4433789-a272-4ea1-9497-365be53cf58a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.158443 Sep 07 13:11:22.193895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 32/66] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:22.194323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 35/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:22 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:22.395319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:22.396021 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:22.402157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.402681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.403113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.403794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.404245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.404668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.546862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.555243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-90a7ed48-b677-4d6d-82a2-4d061b190efc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.164093 Sep 07 13:11:22.555807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 33/68] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:22 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:22.608877 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:22.609526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:22.616338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.616827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.617263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.617952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.618434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.618859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.748028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:22.748754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e96a0f-85ee-4d00-b876-e7bf7d4547db", "tag": "7d0305ef-b6d3-41de-96c2-c924a8086341"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:22.756287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7249858d-2003-4186-9e1f-cc1bea985c1f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.150963 Sep 07 13:11:22.757070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 36/69] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:22 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:22.758465 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.761547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.761547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.773825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] Creating event network-changed:7d0305ef-b6d3-41de-96c2-c924a8086341 for instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db on hv-cinder-79053 Sep 07 13:11:22.778706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-62ae4906-5fd6-4670-85f3-4d6417f7f955 req-dfe95740-efad-46a4-94ed-193d84cfffad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 Sep 07 13:11:22.779532 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 34/70] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:22.883868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:22.884479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:22.890334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.890854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.891288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:22.891999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:22.892429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:22.892853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.028344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.035856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2562cf7d-a464-4bd9-b6fa-113f0e2aa4f6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.156150 Sep 07 13:11:23.037148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 37/71] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:22 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:23.218377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:23.222842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:23.225671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:23.231497 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.232120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.232615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.233673 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.242273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.242798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.519372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.537234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a2ef8ed5-ad47-4534-89ef-fed2b401d413 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.323421 Sep 07 13:11:23.541331 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 35/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:23 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:23.579089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:23.580171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:23.588115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.589138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.590067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.591025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.591757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.592538 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.733059 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.741401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2415c830-3deb-4e98-9dcc-9d777fec4a18 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.167196 Sep 07 13:11:23.741935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 38/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:23 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:23.781051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:23.781658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:23.787684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.788192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.788619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.789293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:23.789738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:23.790153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:23.915831 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:23.923469 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8235567b-12cc-4316-9c70-16a8eb2c00ce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.146271 Sep 07 13:11:23.924032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 36/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:23 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:24.059281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:24.059815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:24.065753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.066240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.066721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.068289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.068380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.068754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.198009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.205705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a514d38-3bde-4cb0-9bc3-2b431757dfaa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.150381 Sep 07 13:11:24.206469 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 39/75] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:24 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:24.567156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:24.567952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:24.585288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.588339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.588339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.588339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.588339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.589158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.764818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:24.765440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:24.771867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.772465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.772859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.779371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.779371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.779371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.912791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.920564 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ab83429e-6cc1-4604-8d27-493e6cfd111d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.159582 Sep 07 13:11:24.921141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 40/76] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:24 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:24.946208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:24.946855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:24.952737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.953223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.953711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.954375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:24.954849 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:24.955275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:24.971082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:24.981175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8c916cb0-66c9-40b6-b761-ce18489b24ba tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.421419 Sep 07 13:11:24.981900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 37/77] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:24 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:25.084834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:25.092658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5d49927d-8361-42b3-a879-884c22d1ea15 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.150271 Sep 07 13:11:25.093224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 41/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:24 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:25.229424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:25.230042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:25.235965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.236450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.236890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.237578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.238032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.238489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.364377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:25.372618 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9ac08f9d-74ec-4a90-8f71-00eea47da91a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.147169 Sep 07 13:11:25.373184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 38/79] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:25 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:25.943464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:25.944091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:25.949973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.950476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.950910 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.951585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.952033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.952452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.004720 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:26.005934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.011851 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.012335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.012765 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.013445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.013899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.014319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.086325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.094283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1981b664-6a8c-4ce5-82bc-58744004a066 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.155089 Sep 07 13:11:26.094883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 42/80] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:25 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:26.117009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:26.117633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.124435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.124764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.125204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.125905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.126363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.126826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.150447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.158152 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-714837b1-7ed9-426d-a844-7d66ed36dac1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.157322 Sep 07 13:11:26.158739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 39/81] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:25 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:26.259547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.267053 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a930c144-abd5-432a-8c49-6f292b5c07a8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.154147 Sep 07 13:11:26.267610 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 43/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:26 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:26.394171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:26.394807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:26.400910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.401387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.401815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.402512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:26.402959 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:26.403374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:26.532137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:26.539887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a7787873-e218-4077-b6f0-b54c678494ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.149514 Sep 07 13:11:26.540447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 40/83] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:26 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:27.119130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:27.119670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:27.126442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.126939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.127382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.128071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.128523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.128944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.181453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:27.182062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:27.188083 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.188572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.189009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.189705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.190154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.190613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.262886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.271707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9b6be55d-8619-4674-a645-9cc7a4b5db91 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.156946 Sep 07 13:11:27.272012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 44/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:27 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:27.291610 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:27.292247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:27.298230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.298745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.299177 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.300112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.300567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.300975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.339709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.348214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fd664800-d37f-4f22-95ed-1841b5113159 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.170558 Sep 07 13:11:27.348798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 41/85] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:27 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:27.443117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.450850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-63df8e1d-cab0-4c21-bc69-9f363eb2a935 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.162956 Sep 07 13:11:27.451421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 45/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:27 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:27.562645 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:27.563282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:27.570009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.570514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.570948 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.571624 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:27.572071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:27.572486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:27.702888 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:27.711181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-24815e7f-05ee-4a48-b339-1e676cfd5bf7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.152447 Sep 07 13:11:27.711738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 42/87] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:27 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:28.293913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.294436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.300680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.301156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.301583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.302909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.303432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.303789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.373579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.374834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.381213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.381713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.382153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.383116 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.383730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.384182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.444878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.453031 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3c8ae547-a2f4-44c5-9cf0-da269844b2fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.163140 Sep 07 13:11:28.454543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 46/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:28.477965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.478733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.484807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.485299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.485730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.486452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.486894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.487435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.540136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.548692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fa98f25f-5eba-41e8-a481-4f2b98214c32 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.179286 Sep 07 13:11:28.551726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 43/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:28.733482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:28.734879 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:28.742327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.743130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.743737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.744701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:28.745153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:28.745571 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:28.797923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.806512 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03d948bd-2edd-4efc-a292-340c0d194c94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.334823 Sep 07 13:11:28.807420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 47/90] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:28.944199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:28.951966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7fef91f8-9cfc-4b49-b5eb-7e032815bee1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.222547 Sep 07 13:11:28.952539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 44/91] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:28 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:29.476761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.477414 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.483746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.484616 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.485324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.486012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.486691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.487362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.581689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.582302 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.588569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.589261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.589859 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.590728 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.591738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.592596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.650559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.659022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-76bcda71-050e-4f0e-a12e-bf3f34918e1a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.186334 Sep 07 13:11:29.659690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 48/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:29.745348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.753024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-09f1550c-60a9-4a53-ace4-d923edc37a75 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.175174 Sep 07 13:11:29.753587 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 45/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:29.830334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.830974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.837007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.837482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.837911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.838623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.839073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.839505 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.964398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:29.973228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-40621a19-3a1f-4f8e-b287-8c4e7cf05542 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.146472 Sep 07 13:11:29.975236 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 49/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:29.976950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:29.978040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:29.984268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.984900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.985370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:29.986164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:29.986700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:29.987198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.120369 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:30.127972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7f685355-0094-4d47-a84d-af4bef99257f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.155623 Sep 07 13:11:30.128539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 46/95] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:29 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:30.682333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:30.682969 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:30.684820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:30.690212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.690753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.691185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.692029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.692502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.693484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.697923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:30.776722 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:30.777490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:30.783843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.784323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.784753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.785431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:30.785879 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:30.786297 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:30.827486 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:30.835963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b54c927-047f-4dc8-b31f-2d65d9d862ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.157411 Sep 07 13:11:30.836544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 50/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:30 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:30.911706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:30.919285 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-01f77839-7a9a-42f7-91b5-54d3935c0f6b tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.146420 Sep 07 13:11:30.919880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 47/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:30 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:30.996769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:30.997384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:31.003324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.003801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.004239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.004923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.005393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.006383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.136641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.144279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d97b2ffd-4170-4f2a-806d-f8b57a05c531 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.151333 Sep 07 13:11:31.144848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 51/98] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:30 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:31.155558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:31.156287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:31.162289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.162793 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.163221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.163893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.164338 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.164752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.168676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:31.297929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:31.305648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-92b0213a-2351-4c4d-a4bd-2bce41b28896 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.153860 Sep 07 13:11:31.306207 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 48/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:31 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:31.859499 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:31.860110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:31.867856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.868436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.868914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.869657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.870112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.870589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.941968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:31.942509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:31.949187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.949675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.950106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:31.950821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:31.951270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:31.951687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.001822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.010435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4bd25f59-afb8-4dcd-ad3f-5b74491b0294 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.154696 Sep 07 13:11:32.011040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 52/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:31 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:32.086224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.093825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e8ede205-9894-4656-8ac3-f280e0d42c2a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.155755 Sep 07 13:11:32.094526 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 49/101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:31 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:32.171305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:32.172303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:32.182235 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.182755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.183204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.183905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.184360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.184778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.332144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:32.332792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:32.339389 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.340093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.340804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.341716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:32.342444 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:32.343117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:32.390662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.400052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8e6feaf1-b293-44c5-a9e0-49aa53da129d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.235372 Sep 07 13:11:32.400875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 53/102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:32 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:32.536673 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:32.547571 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4450c555-eafe-447e-901b-aea5911f899c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.221316 Sep 07 13:11:32.548385 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 50/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:32 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:33.034007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.034750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.041978 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.042585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.043021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.043769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.044219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.044673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.120040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.120818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.141839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.144015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.144885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.145985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.146567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.147098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.343988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.352335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a5136f90-de98-49e3-ae90-40dada437481 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.322517 Sep 07 13:11:33.356041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 54/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:33.424110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.424958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.433791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.434524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.435156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.436585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.437569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.438213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.735300 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.745720 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:33.751855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8729fd44-5c60-4f8b-bc6f-974c9210c94a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.331813 Sep 07 13:11:33.753130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 55/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:33.760898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:33.761950 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:33.768638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.769448 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.770028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.770927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.771552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.772118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.774814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-88bba00a-5a4d-41ae-91d7-2794059b8a61 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.661467 Sep 07 13:11:33.787384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 51/106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:33.871137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148b91ad-ea95-4819-8a38-efc0917b5c10", "name": "network-vif-plugged", "status": "completed", "tag": "2600cb21-5d65-4406-b4b8-dfb49cee0aaf"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:33.883560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:33.884324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:33.884933 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:33.898718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] Creating event network-vif-plugged:2600cb21-5d65-4406-b4b8-dfb49cee0aaf for instance 148b91ad-ea95-4819-8a38-efc0917b5c10 on hv-cinder-79053 Sep 07 13:11:33.905409 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-a6fbfc8f-ea08-4e4f-8226-7314001ad281 req-30acba1e-d487-4bf7-9ec0-d2e9f4c72c85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109111 Sep 07 13:11:33.906162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 52/107] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:34.108422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.116910 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4fd8f672-cd98-4da3-bc3f-249117fb9b4e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.361971 Sep 07 13:11:34.117494 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 56/108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:33 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:34.385675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:34.386796 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:34.392670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.393162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.393596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.394424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.395054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.395476 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.571480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.579342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f1d777c9-d6e8-4203-83a9-5a2a1166ac05 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.198596 Sep 07 13:11:34.579912 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 53/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:34 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:34.775980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:34.776589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:34.782802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.783288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.783721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.784429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.784967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.785373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.801495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:34.802852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:34.809113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.809599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.810211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.811011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:34.811461 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:34.811881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:34.937228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:34.946507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d80d34f2-a911-408d-8bba-9aca3ba7d349 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.174855 Sep 07 13:11:34.947597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 57/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:34 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:35.061043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:35.069075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bb045c96-1ee8-4647-a7ba-cfe502235d0a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.271774 Sep 07 13:11:35.070257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 54/111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:34 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:35.142520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:35.143146 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:35.155632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.156389 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.156683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:35.167100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.167681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.168143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:35.476969 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:35.487838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f3bea3b7-63f9-4e58-973f-482b579f03d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.347766 Sep 07 13:11:35.488670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 58/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:35 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:35.606196 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:35.607448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:35.619558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.621436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.621890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:35.622906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.623368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.625291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:35.870549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:35.880809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6b0bf1e1-98a6-4a35-885c-4c8f23b005d1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.282494 Sep 07 13:11:35.882360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 55/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:35 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:35.973537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:35.974991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:35.986997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.988428 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.989095 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:35.990589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:35.992044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:35.993112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.095351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:36.095980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:36.107332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.107995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.108447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.109216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.109930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.110543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.240735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.253270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c49389b6-6f39-477e-816e-739c070f6343 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.285823 Sep 07 13:11:36.254507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 59/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:35 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:36.514708 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:36.515333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:36.519805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.525251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.525758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.526206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.526945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.527401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.531692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.532970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4a4d154f-3c67-45de-80cd-e2678ad66bc7 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.442683 Sep 07 13:11:36.534530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 56/115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:36 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:36.728232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:36.738092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-95b51012-2253-458e-8d0e-ac7251239302 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.228439 Sep 07 13:11:36.752233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 60/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:36 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:36.905157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:36.905782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:36.916745 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.917290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.917734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:36.918742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:36.919207 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:36.919644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.142201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.156326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8d4ad1ec-f01e-45d1-bfb4-ed08e6086aad tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.254675 Sep 07 13:11:37.171597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 57/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:36 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:37.283711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:37.285467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:37.296298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.297075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.297801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.298751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.299375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.299961 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.558172 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:37.559061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:37.571886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.572517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.574617 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.575622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.576164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.577314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.727343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.740332 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-17683b63-fb40-43d1-a70b-c0490051cd29 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.465888 Sep 07 13:11:37.758619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 61/118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:37 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:37.777295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e73559-759b-40c1-8e2c-fd583122c70c", "name": "network-vif-plugged", "status": "completed", "tag": "1c347cf4-9431-41d8-95e9-13c05eb48661"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:37.794560 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.795221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.795902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.844319 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] Creating event network-vif-plugged:1c347cf4-9431-41d8-95e9-13c05eb48661 for instance a5e73559-759b-40c1-8e2c-fd583122c70c on hv-cinder-79053 Sep 07 13:11:37.859892 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-99dca469-0687-468b-aad1-241179576e7f req-44af2a6c-c7f4-4903-8b75-0be995b7ba1c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096607 Sep 07 13:11:37.860689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 62/119] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:37.872941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:37.876978 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:37.890781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.892167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.892677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.893403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:37.893868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:37.896831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:37.935413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:37.944110 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8e6439ad-d79f-4244-8882-a44a63a98f33 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.390613 Sep 07 13:11:37.958704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 58/120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:37 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:38.171562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.183344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fda5119b-53d2-44c0-9ae4-bd15d8582e54 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.321080 Sep 07 13:11:38.185475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 63/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:37 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:38.185901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:38.186564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:38.193664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.195615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.196199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.197274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.197907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.215631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.399419 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.408268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1a5f9ecd-28e5-45b3-b37b-fdfe939d561d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.227679 Sep 07 13:11:38.408865 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 59/122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:38 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:38.772232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:38.773343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:38.779854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.780985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.781500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.785342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.785893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.786449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.925801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:38.935714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a396294c-2389-412b-8f7a-6da96bd7a7af tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.168210 Sep 07 13:11:38.944411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 64/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:38 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:38.982533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:38.983766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:38.990899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.991443 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.992382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:38.993411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:38.993876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:38.994304 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.207583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:39.209955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:39.211592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:39.220491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-104bf653-5210-45cd-b41b-fde5660a4f24 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.243523 Sep 07 13:11:39.222752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 60/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:38 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:39.224864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.225636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.227059 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.230841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.231523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.232078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.432517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:39.433103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:39.437764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:39.439755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.440523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.441032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.441951 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.442635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.443454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.453084 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2564129d-eae6-4b65-96a5-5adb44651699 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.247335 Sep 07 13:11:39.453735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 65/125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:39 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:39.615821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:39.633247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a37bd7e8-4188-4291-8a7c-7d6045dd39f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.205102 Sep 07 13:11:39.647002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 61/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:39 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:39.958135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:39.958771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:39.964806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.965286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.965715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.966551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.966879 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.967296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.100456 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.108161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bd21390a-f90a-4319-b489-584eac1bbc94 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.153939 Sep 07 13:11:40.108636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 66/127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:39 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:40.247094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:40.247709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:40.253567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.254058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.254529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.255215 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.255670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.256082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.398685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.406939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-85c7b5bb-de07-435b-9cd6-ddf55e124599 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.163908 Sep 07 13:11:40.407514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 62/128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:40 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:40.481194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:40.481931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:40.487702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.488189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.488626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.489315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.489768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.490189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.511917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:40.648985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.659781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:40.661429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:40.669219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.669822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.670336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.671797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.672387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.672891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.680556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-461b2e45-1c82-44d9-ad98-74e2a4cb142b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.203009 Sep 07 13:11:40.682265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 67/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:40 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:40.838627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:40.859442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-08ddda58-51aa-4cf0-8d8a-ea3eb7238144 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.204250 Sep 07 13:11:40.859986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 63/130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:40 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:41.130519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.131128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.138740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.139226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.139820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.140518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.140967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.141397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.300974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.315198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-712b2984-e232-4ec7-94db-623c1e13a4f9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.188240 Sep 07 13:11:41.318444 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 68/131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:41.436382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.439037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.449225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.449968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.450920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.451988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.452674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.453194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.644113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.655766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c0abc1bd-4993-4a1f-8956-43ed09aae6be tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.228624 Sep 07 13:11:41.656713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 64/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:41.706037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.706620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.712970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.713465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.713901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.714650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.715426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.715939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.870515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:41.878226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9f20c2ab-2fb8-4526-b865-414116af2a1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.176721 Sep 07 13:11:41.878839 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 69/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:41.887586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:41.888723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:41.895251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.895743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.896341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.897270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:41.898308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:41.899144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.928237 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:42.051620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:42.059757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-31aa230a-add5-4510-811b-c1721baea9ae tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.176560 Sep 07 13:11:42.060432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 65/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:41 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:42.341029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:42.341665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:42.347785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.348269 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.348704 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.349392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.349842 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.350271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.520789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:42.532321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a8c27627-be86-44de-afea-ddae84f8c13e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.194829 Sep 07 13:11:42.532981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 70/135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:42 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:42.680201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:42.681445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:42.687510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.687994 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.688612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.689472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.690219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.690665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.841003 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:42.849039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-daff6cba-014e-4087-b459-978eb7a4f006 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.172934 Sep 07 13:11:42.849590 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 66/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:42 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:42.905957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:42.905957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:42.912063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.914477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.915047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:42.916007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:42.916520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:42.917587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.082494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:43.083548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:43.106677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.107325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.107918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.108613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.109322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.109748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.159206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.173759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3ee0722d-7f35-4a84-83c3-1391770d0701 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.275866 Sep 07 13:11:43.175387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 71/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:42 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:43.350505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.360382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b4fefa2e-ee2d-47e5-bce3-1db80eac6ba0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.281564 Sep 07 13:11:43.361576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 67/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:43 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:43.555887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:43.556421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:43.562646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.563156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.563593 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.564298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.564869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.565471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.728173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.736666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eec23127-e02f-44b7-8091-38b6da72050f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.185069 Sep 07 13:11:43.737388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 72/139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:43 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:43.885539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:43.887795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:43.899272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.900513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.901164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.902507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.903157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.905005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.177484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.186270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d6c62c9c-7ab6-4455-8614-943d1ce2a4a0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1315 microversion: 2.1 time: 0.315969 Sep 07 13:11:44.196028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c", "name": "network-vif-plugged", "status": "completed", "tag": "6b808cc9-08ba-42d0-9e09-79b6c1566f01"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:44.210654 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 68/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:43 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:44.219108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:44.227101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.228015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:44.238064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.238581 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.240213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.243394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.244021 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.248896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.249381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.249820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.270944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] Creating event network-vif-plugged:6b808cc9-08ba-42d0-9e09-79b6c1566f01 for instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c on hv-cinder-79053 Sep 07 13:11:44.283829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-6b315c0b-9dac-40bf-842f-8c3ce90dfede req-06217d42-7c8b-451b-a7a8-80a67d88838e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093182 Sep 07 13:11:44.284795 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 73/141] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:44.387025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:44.388747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:44.395753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.396316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.397055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.398572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.399099 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.399738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.519881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.530122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-23861999-f279-4ffc-be4e-debe5505a687 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.317598 Sep 07 13:11:44.533628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 69/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:44 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:44.672135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.685868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9f6ca35-b4a6-422b-abf9-955c953605a2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.304664 Sep 07 13:11:44.690285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 74/143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:44 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:44.761696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:44.762692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:44.769847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.770689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.771797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.772810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.773533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.781305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.942516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:44.952099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8f9e23ab-ad1c-4df5-bc06-953e9957e7b0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.195551 Sep 07 13:11:44.953041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 70/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:44 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:45.219763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.220640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.224471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=99 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:45.229133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.229719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.230223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.231294 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.232137 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.232746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.395549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.405213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-23db0a2c-599c-4045-b8f9-97f9c6e320b2 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1502 microversion: 2.1 time: 0.189654 Sep 07 13:11:45.405825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 75/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:45.559063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.559845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.568299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.569442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.571063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.572312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.573553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.573990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.715717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.716338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.732827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.735119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.737864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.743443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.744640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.749940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.902230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.912191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8dddf3c3-d8ed-45de-9f90-07ec880294e3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.357703 Sep 07 13:11:45.913432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 71/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:45.978509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:45.979996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:45.986871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.987553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.988264 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:45.989099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:45.989936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:45.991204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.039823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:46.048788 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cbb155bc-08e3-4d7b-925f-78248cedc82f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.337136 Sep 07 13:11:46.049830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 76/147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:46.263742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:46.271512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-022719d0-3e2c-4c0e-bb53-e708c3b3d350 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.298631 Sep 07 13:11:46.272080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 72/148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:45 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:46.313953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e96a0f-85ee-4d00-b876-e7bf7d4547db", "name": "network-vif-plugged", "status": "completed", "tag": "7d0305ef-b6d3-41de-96c2-c924a8086341"}, {"server_uuid": "87baeec7-935c-4c71-87db-693080de3051", "name": "network-vif-plugged", "status": "completed", "tag": "7c9852da-200d-449a-93d7-10765318ac7b"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:46.337340 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.337818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.338387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.363449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Creating event network-vif-plugged:7d0305ef-b6d3-41de-96c2-c924a8086341 for instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db on hv-cinder-79053 Sep 07 13:11:46.363896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] Creating event network-vif-plugged:7c9852da-200d-449a-93d7-10765318ac7b for instance 87baeec7-935c-4c71-87db-693080de3051 on hv-cinder-79053 Sep 07 13:11:46.384269 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-8bd87702-8fed-4ca0-8157-3dcdad347a5e req-9f301d56-ba74-4bed-b50c-8a89e6622a96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075116 Sep 07 13:11:46.385862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 77/149] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:46.937621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:46.938250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:46.944471 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.946133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.946133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.946873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.947329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.947758 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.990989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aef1cfa-3b33-4b66-94f2-7e09cf4ced8b"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:46.993449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:46.999905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.000823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.000823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.001620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.001938 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.002354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.190463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.199888 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-adfdb47c-8fba-4cfb-9513-526db4933330 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.267088 Sep 07 13:11:47.202034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 73/150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:46 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:47.207144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:47.207956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:47.216545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.217185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.217621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.218602 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.219053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.219637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.488284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.496709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ea223ea0-4544-415b-84b4-817c4cee450a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.293412 Sep 07 13:11:47.497341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 74/151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:47 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:47.516856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:47.517475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:47.524203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.524689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.525321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.526022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:47.526579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:47.526924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:47.731168 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:47.735873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3f1645e0-a0a7-40ef-9f01-03b7c7bb4693 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.222496 Sep 07 13:11:47.736625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 75/152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:47 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:47.845975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c597c370-7d6a-4aec-a18b-4090fd82854e tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "POST /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859051 Sep 07 13:11:47.846627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 78/153] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:11:46 2022] POST /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:48.227451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:48.228011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:48.233976 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.234505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.235120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.235823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.236283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.236713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.381255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.389976 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6c172687-5c03-4483-b5b8-7c3da9edae0f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1365 microversion: 2.1 time: 0.167259 Sep 07 13:11:48.390797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 76/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:48 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:48.523181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:48.524847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:48.545609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.546181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.546670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.547372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.547828 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.548255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.708005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.718337 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9f6c65a7-8cbd-4cc6-9d63-e192fee8574c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.201798 Sep 07 13:11:48.719257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 79/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:48 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:48.759727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:48.760537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:48.766947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.767691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.768353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.769440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:48.770446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:48.771041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:48.958913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:48.967859 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fbcdb23e-242b-40c3-9f39-3214cec69802 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.212603 Sep 07 13:11:48.968685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 77/156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:48 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:49.431738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.432390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:49.439124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.439617 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.440183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.441088 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.441542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.442005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.575063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:49.582710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-94cf966d-f71e-4581-a98f-3d77709d78a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1556 microversion: 2.1 time: 0.161926 Sep 07 13:11:49.583282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 80/157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:49.609733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.610245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:49.616166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.616682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.617265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.618042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.618533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.618957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.735622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2098353f-e15b-4693-8851-bd56c3a0770e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129753 Sep 07 13:11:49.736697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 78/158] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:49.741045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.741658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:49.747975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.748457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.748991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.749571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:49.750022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:49.750468 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:49.994927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:49.995613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:50.004075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:50.004617 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:50.005319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:50.006045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:50.006592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:50.007031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:50.104250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:50.116465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0b20dff0-768a-4dff-8cc6-23ee24f16b5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.378919 Sep 07 13:11:50.117543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 81/159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:50.166603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:50.175379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-dae265ba-e252-4bf2-a1d9-4c7c661b1467 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.186187 Sep 07 13:11:50.176469 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 79/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:49 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:51.139429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:51.140120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:51.147302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.147808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.148834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.149679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.150130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.150754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.199622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:51.200240 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:51.206366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.206945 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.207433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.208067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.208667 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.208946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.372674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.372838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:51.381525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5f2550a8-f82f-4351-ad61-8ba0bef2ed05 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.184902 Sep 07 13:11:51.381525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 80/161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:51 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:51.385075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6b9ae5ac-a03a-4e3d-a29e-a0dc4a5873bf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.249349 Sep 07 13:11:51.385776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 82/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:51 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:51.386293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c", "tag": "6b808cc9-08ba-42d0-9e09-79b6c1566f01"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:51.395900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:51.396585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:51.397195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:51.411316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] Creating event network-changed:6b808cc9-08ba-42d0-9e09-79b6c1566f01 for instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c on hv-cinder-79053 Sep 07 13:11:51.417924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-dc5667f1-21de-4e0c-865b-9898ae9f89e4 req-dc9bbbd3-2ea7-4b8b-b23a-563eb37159a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035274 Sep 07 13:11:51.418545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 81/163] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:52.409952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:52.412075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:52.412810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:52.414891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:52.425591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.428040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.428624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.428969 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.429734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.430697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.431126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.435436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.436238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.436986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:52.437463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:52.437946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:52.602998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.610680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-869c795b-8c98-448a-82b4-da13999b1cef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.205208 Sep 07 13:11:52.611363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 82/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:52 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:52.616593 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:52.625132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a35dbea7-596d-46eb-8990-dcf96129765c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.224167 Sep 07 13:11:52.625706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 83/165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:52 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:53.635022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:53.635640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:53.637670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=96 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.642837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.643328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.643762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.644450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.644903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.645328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.649541 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:53.650729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.650871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:53.657970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.658746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.659684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.660603 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:53.661292 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:53.662004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:53.667626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.800731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:53.808944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3db41188-8704-42e5-892f-dde0e1509a99 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.164918 Sep 07 13:11:53.809578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 84/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:53 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:53.820882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:53.829367 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-14aa86a6-077d-47c7-b7c1-69f664100738 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.198326 Sep 07 13:11:53.830019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 83/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:53 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:54.832025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:54.832646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:54.839762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.840248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.840682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.841368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.841858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.842305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.857714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:54.858488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:54.864399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.864885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.865316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.866001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:54.866476 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:54.866900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:54.977913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:54.985531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-afc3f0b5-c3e8-44d0-9380-ff617d81ffc2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1362 microversion: 2.1 time: 0.157352 Sep 07 13:11:54.986102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 85/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:54 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:54.999425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:55.007428 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2358beea-dc20-4208-9cff-7f31bce4aca9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1321 microversion: 2.1 time: 0.153469 Sep 07 13:11:55.008157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 84/169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:54 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:56.008119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.008742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.018100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.019876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.020745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.022066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.022555 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.023630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.029413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.030036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.037384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.038285 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.039775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.040756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.041427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.042336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.195327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.217174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.219596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-43f7f5a2-1774-4435-9902-1588e039c60b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1547 microversion: 2.1 time: 0.215125 Sep 07 13:11:56.220196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 86/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:56.243963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.244725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.246696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-193b0c11-a8f3-486f-b48a-b1fba8e8f985 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1515 microversion: 2.1 time: 0.221045 Sep 07 13:11:56.247791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 85/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:56.260689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.261185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.261622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.262316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.262798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.263219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.272435 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:56.275957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.283588 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.284243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.284841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.285700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.286292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.287316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.316754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'flavor' on Instance uuid 87baeec7-935c-4c71-87db-693080de3051 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:11:56.373318 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6c927cf4-dcd0-4cdc-9fa1-95ef28406cce tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133648 Sep 07 13:11:56.381327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 87/172] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:56.450979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5ca2d579-e03a-460f-add5-29c63f65f562 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051/action" status: 200 len: 32 microversion: 2.1 time: 0.182450 Sep 07 13:11:56.452090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 86/173] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:11:56 2022] POST /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:11:56.462431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:56.463046 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:56.469740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.470566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.471206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.471955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:56.472404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:56.472999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:56.623545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:56.631173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-063b1840-322e-46c5-99c7-0c299e7b7c5f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.173485 Sep 07 13:11:56.631744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 88/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:56 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:57.654436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:57.655144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:57.661294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:57.661788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:57.662228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:57.662950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:57.663411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:57.663977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:57.792479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e96a0f-85ee-4d00-b876-e7bf7d4547db", "tag": "7d0305ef-b6d3-41de-96c2-c924a8086341"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:57.802824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:57.803727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:57.804470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:57.817173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] Creating event network-changed:7d0305ef-b6d3-41de-96c2-c924a8086341 for instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db on hv-cinder-79053 Sep 07 13:11:57.822815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-740919af-4875-4c15-8ede-b6cf43e932f0 req-cce9e1bd-5e4e-43bc-8e60-3d69f118442b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Sep 07 13:11:57.823598 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 89/175] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:57.845566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:57.853986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2ac8e451-3eba-4234-ac57-4af3ebd4c0c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.203758 Sep 07 13:11:57.854787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 87/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:57 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:58.880528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:58.881350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:58.888832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:58.889326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:58.889762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:58.890489 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:58.890947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:58.891527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:59.031373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:59.039746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-94d23cec-52a0-4533-b5fb-9b8606b65e1b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.163843 Sep 07 13:11:59.040326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 90/177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:58 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:00.062614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:00.063151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:00.069312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.069822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.070250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.071717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:00.072252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:00.072674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:00.204518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:00.212786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6bace965-fb94-4944-9b67-06aee40a381f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.154131 Sep 07 13:12:00.213349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 88/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:00 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:01.236822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:01.237438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:01.244148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:01.244663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:01.245100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:01.245790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:01.246248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:01.246703 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:01.384253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:01.391951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f35f4fb5-021f-4c41-aafa-0284ed039f32 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.158971 Sep 07 13:12:01.392512 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 91/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:01 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:02.417122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:02.417737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:02.423954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:02.424440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:02.424876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:02.425566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:02.426019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:02.426467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:02.556091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:02.564257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-36e31a6b-361c-4465-aeb3-3cfc49389a9e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.151461 Sep 07 13:12:02.564915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 89/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:02 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:03.588029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:03.588636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:03.594933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.595406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.595834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.596507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:03.596955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:03.597374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:03.729726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:03.737638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c28c8ce7-c875-4f8e-87ab-95b6e9c8a267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.153444 Sep 07 13:12:03.738209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 92/181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:03 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:04.760522 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:04.761138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:04.767140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.767623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.768056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.768741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:04.769192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:04.769613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:04.901769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:04.909625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9679d98a-3d14-47ff-8df6-401f677213a7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.153583 Sep 07 13:12:04.910204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 90/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:04 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:05.931646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:05.932261 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:05.938850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.939332 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.939769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:05.940457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.940918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.941343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:06.076345 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:06.083979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7a4f4df9-d313-4b42-887a-889774bf7a4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.156425 Sep 07 13:12:06.084550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 93/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:05 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:07.108075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:07.108619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:07.114644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:07.115132 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:07.115568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:07.116253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:07.116714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:07.117139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:07.249739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:07.257738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-35b7e1ad-dd56-469a-a92d-b669982227f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.154123 Sep 07 13:12:07.258295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 91/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:07 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:08.281229 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:08.281843 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:08.288481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.289027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.289402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:08.290100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.290583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.291008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:08.431859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:08.443297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-51924f3c-cc10-4ef4-8db0-ff1449cecab3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.165892 Sep 07 13:12:08.443902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 94/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:08 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:09.467615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:09.468181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:09.474092 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:09.474612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:09.475047 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:09.475723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:09.476177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:09.476599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:09.620907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:09.629178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-222342cd-f939-4f0c-874f-d5356b9e4549 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.165703 Sep 07 13:12:09.629766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 92/186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:09 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:10.653735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:10.654357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:10.660994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.661476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.661902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.662615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.663061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.663477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.796234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:10.804241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d5a91945-8356-44ed-a731-227ab4dfd342 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.154346 Sep 07 13:12:10.804867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 95/187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:10 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:11.829393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:11.830096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:11.836795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.837283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.837715 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:11.838433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.838976 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.839402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:11.981954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:11.990984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1762ff20-762f-4850-bcd2-11f76f3dfd9b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.167259 Sep 07 13:12:11.991567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 93/188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:11 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:13.014773 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:13.015388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:13.021855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:13.022334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:13.022800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:13.023484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:13.023936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:13.024358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:13.154247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:13.162210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-90012915-89d7-4184-9b6e-a49a7ba35a04 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.151994 Sep 07 13:12:13.162815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 96/189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:13 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:14.184112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:14.184665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:14.190846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:14.191324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:14.191751 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:14.192418 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:14.192894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:14.193308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:14.332717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:14.340448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-59619a1f-1867-44d4-ae18-60f8f367f0b5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.160212 Sep 07 13:12:14.341019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 94/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:14 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:15.364061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:15.364678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:15.367107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=44 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:15.372323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.373556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.373993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:15.374707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.375164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.375588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:15.506769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:15.514586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eac016de-31eb-4d14-97eb-eb250ba262c9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.154294 Sep 07 13:12:15.515095 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 97/191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:15 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:16.537743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:16.538354 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:16.545024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:16.545497 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:16.545929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:16.546668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:16.547116 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:16.547538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:16.678394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:16.686677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3d3c03eb-27a6-4906-a6bc-bf6bf16eb05a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.152856 Sep 07 13:12:16.687242 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 95/192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:16 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:17.713835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:17.714457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:17.720565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:17.721028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:17.721458 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:17.722130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:17.722612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:17.723033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:17.850730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:17.858523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a25cc449-5f09-4a46-aaf6-0baa826583c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.148559 Sep 07 13:12:17.859094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 98/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:17 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:18.881665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:18.882274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:18.888406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:18.889030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:18.889459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:18.890141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:18.890626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:18.891053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:19.015883 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:19.023628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2f196b4c-6124-4d3b-9fa7-ee2ef75f20bc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.145763 Sep 07 13:12:19.024188 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 96/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:18 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:20.047189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:20.047718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:20.055606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:20.056080 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:20.056507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:20.057186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:20.057633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:20.058087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:20.184890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:20.192481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6e18bd0-4ad0-41fc-9de2-a4b58d106845 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.149928 Sep 07 13:12:20.193049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 99/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:20 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:21.215170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:21.215786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:21.221815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.222299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.222771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.223458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.223907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.224328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.359986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:21.363688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:21.368867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7cf24ba1-67d7-4273-9e58-67d9e0b7bda8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.157467 Sep 07 13:12:21.369427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 97/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:21 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:21.959325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:21.959834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:21.966158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.966815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.967346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.968032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.968490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.968915 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.995760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:12:22.034947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:22.084220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e7581361-35bc-4fe3-bb99-41e244010797 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 204 len: 0 microversion: 2.1 time: 0.128521 Sep 07 13:12:22.084729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 100/197] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:12:21 2022] DELETE /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:12:22.093392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:22.094011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:22.100633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.101122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.101557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.102249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.102732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.103160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.231052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:22.240007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-14994149-3ab2-47e3-89f1-71dd577ccfa1 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1554 microversion: 2.1 time: 0.150958 Sep 07 13:12:22.240573 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 98/198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:22 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:22.392547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:22.393247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:22.399167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.399656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.400098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.400784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:22.401241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:22.401669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.532822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:22.540412 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-82a060dd-6d9f-402e-9236-a23855b3b6ed tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.152085 Sep 07 13:12:22.540980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 101/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:22 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:23.262953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:23.264199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:23.270181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.270684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.271114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.271783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.272229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.272644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.407325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.415438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cddac325-b84c-4a96-b4d1-ce29760b3c06 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1554 microversion: 2.1 time: 0.156279 Sep 07 13:12:23.416003 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 99/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:23 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:23.563348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:23.563870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:23.570595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.571083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.571521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.572213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:23.572669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:23.573097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:23.703590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.711649 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0faf387d-be9f-4477-ad5c-26eaee17a3ef tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.152228 Sep 07 13:12:23.712559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 102/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:23 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:24.439173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:24.439820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:24.441744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=34 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:24.446940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.447429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.447863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.448550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.449002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.449424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.585610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.595082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ee09059e-2f94-41c5-8de7-3ef4ad22e9c5 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1554 microversion: 2.1 time: 0.159857 Sep 07 13:12:24.595794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 100/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:24 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:24.735165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:24.735695 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:24.742347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.742862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.743299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.743989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.744442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.744898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.879334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.886991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-acc1812e-3029-43fc-ad18-4864163af1af tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.156658 Sep 07 13:12:24.898035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 103/203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:24 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:25.619310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:25.620042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:25.626675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:25.627240 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:25.627749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:25.628510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:25.629035 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:25.629530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:25.775325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:25.784869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ef4f2a05-f795-4695-a6c6-5c3e2ab66764 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1554 microversion: 2.1 time: 0.169347 Sep 07 13:12:25.785496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 101/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:25 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:25.912758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:25.913373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:25.919742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:25.920333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:25.920771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:25.921465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:25.921922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:25.922345 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.059711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:26.068044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cda6e1c9-5865-44f9-9997-39641f37ab4e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.159009 Sep 07 13:12:26.074583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 104/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:25 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:26.809783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:26.810539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:26.817198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.818031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.819015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.820904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.821559 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.822205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.033103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.047335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-14eed0c0-2be5-4807-9614-23fadbe8ca25 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1554 microversion: 2.1 time: 0.241824 Sep 07 13:12:27.047925 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 102/206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:26 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:27.094685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:27.096467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:27.126679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:27.129406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:27.129937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.130872 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:27.131468 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:27.132104 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.309835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e73559-759b-40c1-8e2c-fd583122c70c", "name": "network-vif-deleted", "tag": "1c347cf4-9431-41d8-95e9-13c05eb48661"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:27.328280 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:27.329131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:27.330365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:27.346975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] Creating event network-vif-deleted:1c347cf4-9431-41d8-95e9-13c05eb48661 for instance a5e73559-759b-40c1-8e2c-fd583122c70c on hv-cinder-79053 Sep 07 13:12:27.353977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-8322ace0-a7c1-41ad-af0d-d0bab7d243fe req-047dd1f1-7f13-4fdc-b516-7b9771b62971 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049830 Sep 07 13:12:27.354631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 103/207] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:12:27.406322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.424037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-82ee1f81-f273-4949-afaf-cb158e69aaa0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.336424 Sep 07 13:12:27.424623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 105/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:27 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:28.072640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:28.075567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:28.083770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.084263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.084751 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.085457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.085911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.086328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.145215 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.146073 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.147039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.147839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lazy-loading 'fault' on Instance uuid a5e73559-759b-40c1-8e2c-fd583122c70c {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:12:28.203632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f2768629fa4e4e86dfea42f4cf674c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dd65c7d44b4858b2194baea7541d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:28.213785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-676ae049-4088-40f1-896f-08a080dfa04a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 200 len: 1351 microversion: 2.1 time: 0.146662 Sep 07 13:12:28.214527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 104/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:28 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:28.449783 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:28.450871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:28.457407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.457986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.458792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.459667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.460128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.460681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.607161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:28.617280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7b3cd4ea-ede1-42bc-9622-f33505f22358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.171371 Sep 07 13:12:28.617966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 106/210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:28 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:29.238769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:29.240576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:29.246737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.247226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.248860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.249805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.250326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.250814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.265482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] HTTP exception thrown: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Request method failure captured: Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c HTTP/1.1 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhhGytXW6BbTOVCfyepJD0TM5KPYWygLJIAL2N6vW9NKAS0T6HFof9VH9MKQdSQStdFWAWRzq2CJWavOxGgPXNfziuOROq7tdZUpJfoa_vz26MzlOiRIETqxdby67BZSJoyu2l-pNQHvPhoobs7nv44IBxCVmx9rc1GhleRu6EMzMw Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:12:29.269809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 88f2768629fa4e4e86dfea42f4cf674c Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.271093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'a5e73559-759b-40c1-8e2c-fd583122c70c'} Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:12:29.271836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.273472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.275091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Returning 404 to user: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:12:29.275091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-beca388e-586b-46d9-9002-2c0708c24be0 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 404 len: 111 microversion: 2.1 time: 0.037923 Sep 07 13:12:29.275091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 105/211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:29 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:29.394857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:29.397323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:29.403258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.403815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.404322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.405255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.405787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.406212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.418372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] HTTP exception thrown: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Request method failure captured: Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c/os-volume_attachments HTTP/1.1 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhhGytXW6BbTOVCfyepJD0TM5KPYWygLJIAL2N6vW9NKAS0T6HFof9VH9MKQdSQStdFWAWRzq2CJWavOxGgPXNfziuOROq7tdZUpJfoa_vz26MzlOiRIETqxdby67BZSJoyu2l-pNQHvPhoobs7nv44IBxCVmx9rc1GhleRu6EMzMw Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:12:29.423153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 88f2768629fa4e4e86dfea42f4cf674c Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.424620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'server_id': 'a5e73559-759b-40c1-8e2c-fd583122c70c'} Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:12:29.425433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:29.426765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:29.428133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Returning 404 to user: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:12:29.428133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ef844ff6-27db-48dc-8c88-32ff0419567a tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033870 Sep 07 13:12:29.428133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 107/212] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:12:29 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:29.641569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:29.642173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:29.648323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.649023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.650035 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.650839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:29.651775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:29.651775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:29.794334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:29.803118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c505125b-8f06-403e-91d4-862ae8a8d484 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.166295 Sep 07 13:12:29.803689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 106/213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:29 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:30.666354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:30.666883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:30.673832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.674394 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.675123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.676106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.676308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.676675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.692383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] HTTP exception thrown: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Request method failure captured: Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c HTTP/1.1 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhhGytXW6BbTOVCfyepJD0TM5KPYWygLJIAL2N6vW9NKAS0T6HFof9VH9MKQdSQStdFWAWRzq2CJWavOxGgPXNfziuOROq7tdZUpJfoa_vz26MzlOiRIETqxdby67BZSJoyu2l-pNQHvPhoobs7nv44IBxCVmx9rc1GhleRu6EMzMw Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:12:30.694573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 88f2768629fa4e4e86dfea42f4cf674c Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.696102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'a5e73559-759b-40c1-8e2c-fd583122c70c'} Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:12:30.699805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.701157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.703263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Returning 404 to user: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:12:30.703263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-487e81ae-556d-4433-8f52-3e8bf419eae6 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 404 len: 111 microversion: 2.1 time: 0.034108 Sep 07 13:12:30.703263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 108/214] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:12:30 2022] DELETE /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:30.709044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:30.709663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] [instance: a5e73559-759b-40c1-8e2c-fd583122c70c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:30.715725 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.716319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.716779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.717512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.717940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.718470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.731697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] HTTP exception thrown: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Request method failure captured: Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c HTTP/1.1 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhhGytXW6BbTOVCfyepJD0TM5KPYWygLJIAL2N6vW9NKAS0T6HFof9VH9MKQdSQStdFWAWRzq2CJWavOxGgPXNfziuOROq7tdZUpJfoa_vz26MzlOiRIETqxdby67BZSJoyu2l-pNQHvPhoobs7nv44IBxCVmx9rc1GhleRu6EMzMw Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:12:30.733487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/51dd65c7d44b4858b2194baea7541d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 51dd65c7d44b4858b2194baea7541d45 Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081425123 Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 88f2768629fa4e4e86dfea42f4cf674c Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-DeleteServersTestJSON-1081425123-project Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.734763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'a5e73559-759b-40c1-8e2c-fd583122c70c'} Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:12:30.735448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. Sep 07 13:12:30.736929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:12:30.738100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] Returning 404 to user: Instance a5e73559-759b-40c1-8e2c-fd583122c70c could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:12:30.738100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b59a401e-7f19-44d8-98f7-4832d3f10aa9 tempest-DeleteServersTestJSON-1081425123 tempest-DeleteServersTestJSON-1081425123-project] 10.222.0.65 "GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c" status: 404 len: 111 microversion: 2.1 time: 0.029775 Sep 07 13:12:30.738100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 107/215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:30 2022] GET /compute/v2.1/servers/a5e73559-759b-40c1-8e2c-fd583122c70c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:30.826827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:30.827702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:30.834118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.834866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.835546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.836650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.837181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.837689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:31.062630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:31.071171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aab545a6-e02d-42c8-81db-820aab36da2b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.248262 Sep 07 13:12:31.071549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 109/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:30 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:32.095742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:32.096942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:32.122922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.124216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.124496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.125220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.125791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.126290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.276260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:32.288389 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb175ebb-3491-4b7c-ab63-d85762899fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.199138 Sep 07 13:12:32.290557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 108/217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:32 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:33.311537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:33.312232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:33.320363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:33.320863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:33.321313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:33.322029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:33.322539 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:33.322952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:33.470205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:33.478702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-74aa2cc2-324e-49b3-a637-0fc063a26f44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.171061 Sep 07 13:12:33.479287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 110/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:33 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:34.502778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:34.504371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:34.516560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.517085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.517564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.518552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.519154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.519754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.662046 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:34.669895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-58e59d51-f75b-4001-af71-9eb5a8031044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.171541 Sep 07 13:12:34.670616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 109/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:34 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:35.694037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:35.694761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:35.701613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:35.702668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:35.703175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:35.703970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:35.704505 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:35.705007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:35.840320 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:35.848889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b9e110ce-6fd1-4dce-a6bc-0a9da509ddd8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.158611 Sep 07 13:12:35.849467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 111/220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:35 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:36.872868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:36.873404 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:36.880204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.880677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.881105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:36.881776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.882221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.882662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:37.014721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:37.022221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1655a7e8-ac1a-41c4-bf5f-2eb22d42a84a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.153282 Sep 07 13:12:37.022816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 110/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:36 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:38.044807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:38.045418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:38.052408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.052898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.053364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.054052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.054796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.055219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.183056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:38.191243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bd97fe63-a8a2-42a3-b82e-844345d2df8a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.150277 Sep 07 13:12:38.191814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 112/222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:38 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:39.215503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:39.216113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:39.222858 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.223337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.223766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.224438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.224884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.225301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.350864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:39.358775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2260f3c3-ed75-45de-a796-7753a397bbbd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.146948 Sep 07 13:12:39.359346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 111/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:39 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:40.381320 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:40.381869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:40.388301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:40.388785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:40.389222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.390151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:40.390638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:40.391068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.523067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:40.531476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-96e4a529-94e4-4a69-8aec-72987fdcdf82 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.154097 Sep 07 13:12:40.532041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 113/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:40 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:41.553819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:41.554355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:41.560593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:41.561071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:41.562141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:41.562850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:41.563381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:41.563806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:41.691010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:41.698734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-828bffe2-1161-4a1c-ad2d-2d959d3e80c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.148852 Sep 07 13:12:41.699296 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 112/225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:41 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:42.722069 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:42.722724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:42.729169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:42.729658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:42.730093 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:42.730935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:42.731400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:42.731829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:42.872584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:42.881785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d0e6ecd0-1cd8-47ce-ba3b-aee235fafe44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.164526 Sep 07 13:12:42.882365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 114/226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:42 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:43.905108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:43.906363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:43.912646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:43.913135 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:43.913631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:43.914254 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:43.914764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:43.915190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:44.043184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:44.052749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6370bb56-c6f3-4b4b-a9bd-a157365fbb6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.151573 Sep 07 13:12:44.054038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 113/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:43 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:45.076010 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:45.076564 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:45.083588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:45.084070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:45.084498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:45.085187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:45.085638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:45.086056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:45.220601 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:45.228286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9d2a45dc-30c6-4d12-9471-c36402c73a70 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.156284 Sep 07 13:12:45.228861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 115/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:45 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:46.252181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:46.252790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:46.258890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:46.260695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:46.261142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:46.261852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:46.262300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:46.262748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:46.391410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:46.399187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-99487da9-7995-4486-a442-cd65d29abc0e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.151362 Sep 07 13:12:46.399748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 114/229] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:46 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:47.421818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:47.422535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:47.424629 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:47.429751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:47.430510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:47.430957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:47.431638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:47.432094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:47.432517 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:47.561145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:47.569576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c32d3875-171b-4500-aa8f-93a136f71d7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.151765 Sep 07 13:12:47.570125 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 116/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:47 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:48.592931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:48.593464 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:48.599607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:48.600086 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:48.600515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:48.601191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:48.601638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:48.602053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:48.733466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:48.742000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-40f80453-20fb-4f2d-b19d-509379e19651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.153043 Sep 07 13:12:48.742594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 115/231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:48 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:49.764922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:49.765687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:49.772918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:49.773404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:49.773844 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:49.774565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:49.775022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:49.775455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:49.913885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:49.921836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e4729e66-5071-4d87-a04d-390fec864a3b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.160658 Sep 07 13:12:49.922559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 117/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:49 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:50.945184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:50.945797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:50.951789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:50.952272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:50.952708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:50.953395 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:50.954567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:50.955096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:50.959230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:51.084636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:51.092235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9dd8ad38-86b6-4f18-8c83-c1e2a1899f23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.150837 Sep 07 13:12:51.092866 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 116/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:50 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:52.117921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:52.118694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:52.127206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:52.127206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:52.127624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:52.128359 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:52.128862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:52.129298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:52.133524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:52.279328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:52.288879 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a949ac0a-f38b-4e87-ad21-a716996c2265 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.177250 Sep 07 13:12:52.289466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 118/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:52 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:53.312939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:53.314522 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:53.320691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.321180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.321708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:53.322536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.323096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.323592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:53.495489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:53.505036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-92c78934-1777-4550-8201-23a24fe14480 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.195934 Sep 07 13:12:53.518911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 117/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:53 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:54.530589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:54.531201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:54.539208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:54.539972 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:54.540497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:54.541265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:54.542192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:54.542899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:54.769372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:54.785883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c0631343-cbb9-4cb3-84af-12f36000ac2f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.258947 Sep 07 13:12:54.787038 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 119/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:54 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:55.809146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:55.809890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:55.811806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=38 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:55.817853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:55.818334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:55.818809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:55.819507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:55.819975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:55.820513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:55.971087 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:55.984023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5c0a667d-3ee2-4740-883c-70c918485a5e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1521 microversion: 2.1 time: 0.178843 Sep 07 13:12:56.011125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 118/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:55 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:57.009225 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:57.010516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:57.019314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.019975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.020419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.021126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.021587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.022016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.178327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:57.187497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3a809327-0fb4-4e29-b427-a65f2882c3ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1501 microversion: 2.1 time: 0.183105 Sep 07 13:12:57.189579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 120/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:57 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:57.216609 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:57.217238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:57.225203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.225700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.226141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.226874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.227337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.227767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.383731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:57.392651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5ab43556-7413-45c6-8e33-3cce30b46a46 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1515 microversion: 2.1 time: 0.182110 Sep 07 13:12:57.393342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 119/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:57 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:58.890643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:58.893156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:58.900027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.900641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.901185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.901987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.902580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.903128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.930856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'flavor' on Instance uuid 148b91ad-ea95-4819-8a38-efc0917b5c10 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:12:59.057712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-60fc17be-fda4-4349-b62a-07fbd2011044 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/action" status: 200 len: 32 microversion: 2.1 time: 0.171673 Sep 07 13:12:59.063112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 121/240] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:12:58 2022] POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:12:59.069101 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:59.070369 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:59.077134 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:59.077765 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:59.078642 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:59.079750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:59.080536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:59.081257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:59.279295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:59.289863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9c9ef753-2a11-4a49-9c19-a7a1353e85c7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.224621 Sep 07 13:12:59.290610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 120/241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:59 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:00.314545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:00.315883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:00.324962 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:00.326191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:00.326894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:00.327927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:00.328605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:00.329759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:00.533277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:00.542958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e6c39727-d976-403e-a905-3854423a0682 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.233464 Sep 07 13:13:00.544030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 122/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:00 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:01.567618 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:01.568139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:01.576327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:01.577096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:01.577784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:01.578749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:01.580431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:01.581279 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:01.750560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:01.760341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d85a78c0-c98a-40ab-bf63-0b7a11284a4d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.197243 Sep 07 13:13:01.761072 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 121/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:01 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:02.784534 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:02.785159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:02.791599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:02.792085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:02.792535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:02.793228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:02.793688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:02.794121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:02.936587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:02.944592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ab6f1a6d-c9f7-4223-8f95-d128235e4ee0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.164729 Sep 07 13:13:02.945178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 123/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:02 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:03.968182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:03.968716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:03.974666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:03.975158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:03.975731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:03.976669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:03.977193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:03.977607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:04.129332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:04.137096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-737469e9-de11-41e9-903f-754a1c43a0d7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.173187 Sep 07 13:13:04.137863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 122/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:03 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:05.162059 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:05.162709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:05.169605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:05.170221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:05.170755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:05.171547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:05.172275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:05.172409 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:05.317077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:05.325519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cdf302fa-aa18-40fb-8bc8-40ac08fd3336 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.167212 Sep 07 13:13:05.326313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 124/246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:05 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:06.349037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:06.349658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:06.356099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:06.357032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:06.357876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:06.358800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:06.359411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:06.360091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:06.622553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:06.650261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-842511ff-1134-47aa-8b0e-80e85cb3989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.304889 Sep 07 13:13:06.667731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 123/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:06 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:07.686247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:07.687532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:07.696938 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:07.697438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:07.697900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:07.698627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:07.699087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:07.699514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:07.964560 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:07.975356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-344649bd-21f5-44cb-b15f-6f0ed40a7ecb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.298836 Sep 07 13:13:07.976089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 125/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:07 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:08.984478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:08.985027 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:08.991928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:08.992419 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:08.994442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:08.995159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:08.995625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:08.996052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:09.000661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:09.001453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:09.010096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:09.010767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:09.011279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:09.012065 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:09.012522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:09.012952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:09.021455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a4c12e20-6774-439c-92a6-97fee9e0489c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/ips" status: 200 len: 145 microversion: 2.1 time: 0.040948 Sep 07 13:13:09.022035 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 124/249] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:13:08 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:09.152012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:09.160087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1de154f4-ddea-454f-9bce-007259c37a85 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.164412 Sep 07 13:13:09.160661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 126/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:08 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:09.997837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1770612525", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "networks": [{"uuid": "a06c5c49-3bcd-4c51-a1aa-cf30903a611c"}]}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:10.052803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] validate_networks() for [('a06c5c49-3bcd-4c51-a1aa-cf30903a611c', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:13:10.184012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:10.184628 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:10.191873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.192368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.192800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.193504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.193951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.194371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.515285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:10.524257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7d8ac07d-14bb-497a-bf10-98fd44af6bcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.344820 Sep 07 13:13:10.539009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 127/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:10 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:10.670040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:13:10.670495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:13:10.671005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:13:10.671414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:13:10.671826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:13:10.682766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.682965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.683416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.684147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.684606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.685033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.701871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Getting quotas for project 83fb136c97404ff6bdd4e287bed942d3. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:10.707412 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Getting quotas for user 6268a000bf92406eb35699ed97711962 and project 83fb136c97404ff6bdd4e287bed942d3. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:10.720493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:13:10.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:13:10.779151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fa0794d0-19da-4861-995e-f5cc780bb27c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785635 Sep 07 13:13:10.780336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 125/252] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:13:10.792339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4bd45db3-4aa6-4328-ac6a-d3dee17febbd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:10.792963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4bd45db3-4aa6-4328-ac6a-d3dee17febbd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:10.860354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4bd45db3-4aa6-4328-ac6a-d3dee17febbd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:10.869242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4bd45db3-4aa6-4328-ac6a-d3dee17febbd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1219 microversion: 2.1 time: 0.080649 Sep 07 13:13:10.870018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 128/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:10 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:11.551105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:11.551860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:11.560451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:11.560977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:11.561488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:11.562312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:11.562963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:11.564098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:11.707325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:11.717636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-806234d7-63ec-486f-b002-3801a1585e48 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.171837 Sep 07 13:13:11.718373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 126/254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:11 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:11.894897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:11.895623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:11.902747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:11.903435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:11.903884 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:11.904590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:11.905049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:11.905475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:11.969250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:11.977096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e27b1152-2fed-4b41-a614-c166bf0b336f tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1271 microversion: 2.1 time: 0.087934 Sep 07 13:13:11.977688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 129/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:11 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:12.742252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:12.743195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:12.749686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.750183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.750693 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.751396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.752020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.752731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.893794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:12.902299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4f0592ff-5cb4-4e09-9326-b90f89907280 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.163956 Sep 07 13:13:12.903097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 127/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:12 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:13.000373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:13.001607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:13.008436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.008913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.009518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.010375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.011023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.011817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.086051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:13.094102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5d28111d-27e2-4311-9e77-17fc8039cf22 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1277 microversion: 2.1 time: 0.097505 Sep 07 13:13:13.106860 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 130/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:12 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:13.572894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:13.573382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:13.579451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.580523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.581129 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.581826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.582440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.583111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.607881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4364870a-df6e-4b52-b14a-2149ff3caf97 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/ips" status: 200 len: 151 microversion: 2.1 time: 0.039428 Sep 07 13:13:13.608569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 128/258] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:13:13 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:13.931392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:13.932431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:13.943550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.945158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.945516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.946792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:13.947328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:13.947988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.118170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:14.118818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:14.125054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.126193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.126671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.129597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.130266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.130924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.169758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:14.184567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-99a9b70b-a8b4-40b0-bf9b-7890bf59989f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.261179 Sep 07 13:13:14.185663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 131/259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:13 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:14.211075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d045a3e-061f-4390-8e95-89312d5d134b", "tag": "aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:14.226692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.226915 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.227368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.241050 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] Creating event network-changed:aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba for instance 7d045a3e-061f-4390-8e95-89312d5d134b on hv-cinder-79053 Sep 07 13:13:14.247055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-d38eae57-40d5-4ae9-b63d-a30dfdd6c023 req-e6107291-7b5d-4f04-9af8-3ed0a9f1b9d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056404 Sep 07 13:13:14.248964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 132/260] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:14.311075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:14.321344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0341a03a-1daa-4c76-a8b2-44b7a0523027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.207056 Sep 07 13:13:14.322196 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 129/261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:14 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:14.642280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec45c12-ab38-4df0-8c64-4434b24265c0"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:14.645209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:14.653584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.654301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.654781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.655650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.656111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.656541 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:15.039502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7df9efa0-0238-4ffb-8178-cb042253d0a1"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:15.042102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:15.048766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:15.049317 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:15.049986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:15.050742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:15.051233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:15.051726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.110837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:16.267403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-00e16813-86ae-406c-b77b-044e2e30c30b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.628973 Sep 07 13:13:16.276530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 133/262] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:14 2022] POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments => generated 194 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:16.291348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:16.292070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:16.297475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cf0cafb7-7f2b-45af-a062-9e8da6801f67 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.260726 Sep 07 13:13:16.299918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 130/263] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:15 2022] POST /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 194 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:16.307929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:16.308729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:16.309330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.310234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:16.311112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:16.311702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.334097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:16.337049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:16.352449 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:16.354562 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:16.355300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.356264 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:16.357607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:16.358337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:16.525345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:16.534928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-aed36304-69bb-47e6-b887-f428afdf9e62 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.232651 Sep 07 13:13:16.535673 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 131/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:16 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:16.581036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:16.597146 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03798919-fabb-46c7-be84-1809703522b7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.322867 Sep 07 13:13:16.598094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 134/265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:16 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:17.557793 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:17.558310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:17.565314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.565807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.566250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.567118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.567582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.568008 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.622556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:17.623937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:17.626476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=40 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:17.633337 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.634126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.634770 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.635564 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.636103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.636598 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.711944 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:17.717458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:17.723985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e266d554-c629-4514-8f82-733d5b6fa2c7 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.169539 Sep 07 13:13:17.724350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 132/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:17 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:17.793761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:17.801607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c4ba5bab-ecd3-4642-a7f6-a3f0eec170ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.183129 Sep 07 13:13:17.802278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 135/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:17 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:18.744998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:18.745611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:18.753537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.753972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.754434 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.755199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.755689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.756112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.825180 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:18.825910 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:18.833438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.834087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.834657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.835455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:18.836118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:18.836766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.906376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:18.915965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9ddc2e02-24c1-4788-bec1-8064288e5513 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.174731 Sep 07 13:13:18.916779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 133/268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:18 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:18.992162 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:19.001710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-92a54a09-d4eb-4ce5-8928-79da2cc80c7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.180410 Sep 07 13:13:19.014435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 136/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:18 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:19.940493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:19.942026 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:19.948679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:19.949305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:19.949840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:19.950680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:19.951261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:19.951906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.027278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:20.028548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:20.036403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.036959 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.037572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.038661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.039272 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.040938 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.101042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:20.108773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-81cc528d-7d5c-4d51-b82a-1c0b61e1cd66 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.173135 Sep 07 13:13:20.109346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 134/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:19 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:20.129665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d045a3e-061f-4390-8e95-89312d5d134b", "name": "network-vif-plugged", "status": "completed", "tag": "aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:20.140615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.141205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.141742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.153763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] Creating event network-vif-plugged:aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba for instance 7d045a3e-061f-4390-8e95-89312d5d134b on hv-cinder-79053 Sep 07 13:13:20.158816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-4b0fddaf-8dad-49a2-981d-adf71de0cdb3 req-ab19d6e2-7206-4eb7-bd22-952527c3d060 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Sep 07 13:13:20.159551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 135/271] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:20.189387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:20.197743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ab608426-2ff6-4c28-88aa-49a02ab2db98 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.176173 Sep 07 13:13:20.198299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 137/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:20 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:21.128322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:21.129112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:21.133894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:21.134635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:21.141589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.142068 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.142523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:21.143703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.144154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.144661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:21.222449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:21.223064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:21.224930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:21.230655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.231140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.231570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:21.232259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.232709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.233129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:21.281560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:21.290055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fe38045b-404d-4149-a135-2c75356405d9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.162624 Sep 07 13:13:21.290652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 136/273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:21 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:21.362756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:21.370369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b5913239-01ac-4a2c-af63-1e52d71c7140 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.152589 Sep 07 13:13:21.370960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 138/274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:21 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:22.312817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:22.313431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:22.319961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.320447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.320885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.321572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.322052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.322506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.393296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:22.394166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:22.401418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.401940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.402378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.403265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:22.404230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:22.404667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:22.489616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:22.497937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-36882d85-d637-4308-8dc7-0f333ff98f3e tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1319 microversion: 2.1 time: 0.188793 Sep 07 13:13:22.498564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 137/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:22 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:22.821760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:22.831014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8fb2f2e8-2106-45d4-8183-48102d4823e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.441422 Sep 07 13:13:22.832515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 139/276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:22 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:23.525371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:23.526011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:23.532440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.532922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.533370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.534716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.535178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.535599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.665801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:23.673536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5b6b7241-8a8d-4233-9c81-fbfc9e190474 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1508 microversion: 2.1 time: 0.151988 Sep 07 13:13:23.674175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 138/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:23 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:23.855361 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:23.856061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:23.863309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.863800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.864243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:23.865611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:23.866464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:23.866897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:24.001670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:24.012883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a82ca08d-7d39-45d8-bff7-46b4e7b329a0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.161417 Sep 07 13:13:24.013763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 140/278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:23 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:25.012487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:25.023726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:25.024295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:25.024734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.038898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:25.039747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:25.047147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:25.047878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:25.048402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.049172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:25.050235 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:25.051018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.241336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:25.249684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e89aea50-512a-44b5-ba0a-1eb822968f07 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.215550 Sep 07 13:13:25.267332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Going to try to stop instance {{(pid=120737) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:13:25.277103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 141/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:25 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:25.332271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a2bc2569-edb8-44b0-abdc-542228b1b596 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action" status: 202 len: 0 microversion: 2.1 time: 0.325102 Sep 07 13:13:25.332968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 139/280] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:25 2022] POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:13:25.341573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:25.342195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:25.348688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:25.349212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:25.349656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.350579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:25.351047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:25.351480 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.568014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:25.589676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-42ee7685-7784-47e3-a509-bced822875b5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.250951 Sep 07 13:13:25.590683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 142/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:25 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.284057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.285568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.296960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:26.296960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.296960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.296960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.297306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.297306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.297306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.439818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:26.448669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4fa050f1-f492-46e3-bcdc-ecf80eaf7fcd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1501 microversion: 2.1 time: 0.169473 Sep 07 13:13:26.449329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 140/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.471718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0506d55f-4fc9-4e4b-8007-cf1524fd25fd"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:26.474542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.481304 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.481488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.482289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.482630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.483176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.483510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.508854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] HTTP exception thrown: Cannot 'attach_volume' instance 148b91ad-ea95-4819-8a38-efc0917b5c10 while it is in vm_state rescued Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Request method failure captured: Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/os-volume_attachments HTTP/1.1 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 74 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhaui2HLaVmzSyWD7xmJnx7cxSyM9KR_w_2EG9rAfoc8wO3BASPxSFNmhIsZFRLS-NhxX7k46xSthReO20TPNHaDj9pnzEhHNnH-EiLztw8qz4cYSBG18Zcx0DfjUtQRbBxt5MxP_yPAQx1e3IfkTI_Hf2jMO78c-nKorRLfv-ReB4 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:13:26.510599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb085890f54a44be94190bd67485bc2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: d5a9fcebd3164b59893658ad92dfcafb Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {"volumeAttachment": {"volumeId": "0506d55f-4fc9-4e4b-8007-cf1524fd25fd"}} Sep 07 13:13:26.512152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Cannot 'attach_volume' instance 148b91ad-ea95-4819-8a38-efc0917b5c10 while it is in vm_state rescued Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'server_id': '148b91ad-ea95-4819-8a38-efc0917b5c10', 'body': {'volumeAttachment': {'volumeId': '0506d55f-4fc9-4e4b-8007-cf1524fd25fd'}}} Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:26.513138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 148b91ad-ea95-4819-8a38-efc0917b5c10 while it is in vm_state rescued Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:26.514527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:26.515836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:26.515836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:26.515836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 148b91ad-ea95-4819-8a38-efc0917b5c10 while it is in vm_state rescued Sep 07 13:13:26.515836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:13:26.516994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Returning 409 to user: Cannot 'attach_volume' instance 148b91ad-ea95-4819-8a38-efc0917b5c10 while it is in vm_state rescued {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:26.517866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-281b5257-b5c7-4425-b416-a17076ab1fc5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050535 Sep 07 13:13:26.528191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:26.528723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.530502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 143/283] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:26 2022] POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:13:26.535375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.535860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.536293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.536983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.537430 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.537845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.608890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-07adb72c-ba5a-4358-a340-7b03d5756e21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/action" status: 202 len: 0 microversion: 2.1 time: 0.083735 Sep 07 13:13:26.610772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 141/284] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:26 2022] POST /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:13:26.619252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.620175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.620784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.621747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.626559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.627295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.628455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.629350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.629471 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.632017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.632178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.632294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.632395 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.632492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.632492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.632492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.796958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:26.805487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-271ae91f-7599-4981-88d6-028c1170c1fc tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.189102 Sep 07 13:13:26.806000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 142/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.847119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:26.856257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ce8fed70-9fbb-4ef4-9b51-84471af02eba tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.246319 Sep 07 13:13:26.857055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 144/286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:27.829151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:27.829867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:27.837133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.837780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.838316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.839150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.839700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.840629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.884900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:27.886376 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:27.895393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.896251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.896886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.897835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.898590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.899240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:28.027537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:28.044696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f3bc3ce1-6d06-4831-aebb-7da5098c07e6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.219342 Sep 07 13:13:28.046138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 143/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:27 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:28.298790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:28.309056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c4d6a26e-5e5b-43ea-8a5d-ebf1d6ee9e44 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.432460 Sep 07 13:13:28.309765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 145/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:27 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:29.069819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:29.071408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:29.083420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:29.084491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:29.084995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:29.085705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:29.086328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:29.086904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:29.252881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:29.264724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c9f883e1-36db-4281-b2b1-fbc6321fd25c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.199790 Sep 07 13:13:29.266856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 144/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:29 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:29.339465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:29.351183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:29.368269 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:29.368693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:29.369143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:29.369858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:29.370314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:29.370827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:29.423586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-aaa26b98-cfb8-40fd-ad7d-5c770448e72b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: .version_select at 0x7f7f2b9c9a60>, body: {"keypair": {"name": "tempest-keypair-796993315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZhPf82V88bWJQQVSrGXZhsumDkrKpAwLTwcv6Kc8cry7dPopYK+zKi66ROmzMob+J5rJfi5JDMqaXTzuQX60mtKwaQyVs7QNGGpQXHrZKU0XajA3nvAsyYiYLOFl2/eA=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:29.445965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-aaa26b98-cfb8-40fd-ad7d-5c770448e72b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:29.456073 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-aaa26b98-cfb8-40fd-ad7d-5c770448e72b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:29.507869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-aaa26b98-cfb8-40fd-ad7d-5c770448e72b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088204 Sep 07 13:13:29.515556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 145/290] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:13:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:29.977186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:29.988477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-acc0baaa-8746-46e1-b52c-cd522b7c72fc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.658618 Sep 07 13:13:30.006847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 146/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:29 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:30.293108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:30.293729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:30.301263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:30.302400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:30.303067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:30.303970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:30.304666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:30.305788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:30.529329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:30.547620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ce8e0b8c-c538-439c-80f2-0d034653336f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.262255 Sep 07 13:13:30.549315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 146/292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:30 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:31.022551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:31.025386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:31.038850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.040925 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.042693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.043591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.044630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.045293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.244026 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619720152", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be10bb5-1b7b-48d3-b1b4-958b66e89a40"}], "security_groups": [{"name": "tempest-securitygroup--1591722018"}], "key_name": "tempest-keypair-796993315", "user_data": "}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:31.313025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:31.359624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9673c789-9e01-4070-94e4-24fbc1fa4486 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.348643 Sep 07 13:13:31.376774 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 147/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:31 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:31.428970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] validate_networks() for [('0be10bb5-1b7b-48d3-b1b4-958b66e89a40', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:13:31.576349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:31.577181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:31.585034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.585530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.586187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.586918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.587526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.588109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.871147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:31.883720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a81fd3a1-a913-4888-a67c-67044728c59b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.311665 Sep 07 13:13:31.884595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 148/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:31 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:31.966566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:13:31.967080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:13:31.967556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:13:31.967960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:13:31.968369 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:13:31.978866 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.979517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.979981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.980868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.981185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.981620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.004224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:32.028698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:32.060456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:13:32.062985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:13:32.146704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-609fc75f-6c9a-40f3-b966-9b7ecd3362ef tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.906865 Sep 07 13:13:32.147367 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 147/295] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:13:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:13:32.159991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eb22c142-7e56-4159-aa91-c3ce7494e3ed tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:32.160945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eb22c142-7e56-4159-aa91-c3ce7494e3ed tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:32.386139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:32.386892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:32.396100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eb22c142-7e56-4159-aa91-c3ce7494e3ed tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:32.405130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.405968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.406357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eb22c142-7e56-4159-aa91-c3ce7494e3ed tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1240 microversion: 2.1 time: 0.251173 Sep 07 13:13:32.406805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.406961 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 149/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:32 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1240 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:32.426633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.426633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.426633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.655701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:32.669668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c8a9875b-3a30-46c4-8f13-11414592602c tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.286266 Sep 07 13:13:32.671950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 148/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:32 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:32.908792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:32.910154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:32.919869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.920616 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.921161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:32.922639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:32.923251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:32.923935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.078355 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:33.092553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b43c85a2-17c2-4963-93a8-d91a79f8620c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1509 microversion: 2.1 time: 0.188089 Sep 07 13:13:33.093148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 150/298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:32 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:33.438918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:33.440160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:33.448698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.449533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.449969 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.450696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.451150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.451752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.539501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:33.543254 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:33.548390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-755d3432-aec6-4620-b1f3-762d7b5f1caf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1236 microversion: 2.1 time: 0.113292 Sep 07 13:13:33.549520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 149/299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:33 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:33.699412 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:33.700766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:33.707878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.708405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.709022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.709948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:33.710685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:33.711057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.715440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:33.948500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:33.958057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4f02edda-c06c-4aa5-bde9-5fd1be880bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.262654 Sep 07 13:13:33.979657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 151/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:33 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:34.118149 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:34.119475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:34.127117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.127749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.128710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.129721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.130198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.130833 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.382965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:34.391332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-80a54be5-1e11-40ff-9e83-4e3bf7c5dde6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1515 microversion: 2.1 time: 0.279005 Sep 07 13:13:34.393402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 150/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:34 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:34.574710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:34.575779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:34.587659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.589780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.590570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.592053 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.593345 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.595337 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.763663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:34.785369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c1c61a0c-b2cd-4189-88b9-523c83977154 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1300 microversion: 2.1 time: 0.213237 Sep 07 13:13:34.786230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 152/302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:34 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:34.989499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:34.990325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:34.999006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.999732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.000314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.001175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.001775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.002361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.287524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:35.296261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e66f878e-266b-45c6-a167-f9010ab50ec2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.312279 Sep 07 13:13:35.315225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 151/303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:34 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:35.810962 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:35.811766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:35.824128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.825013 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.825538 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.828302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.828911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.829457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:36.163380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:36.166506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-30d7ab9a-aae9-45be-960b-6919f797a063 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: .version_select at 0x7f7f2bad0f70>, body: {"keypair": {"name": "tempest-keypair-1092454450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHiu15KeXv5VDrn3rY1JWrV6KH2HW9HR6khuYTQ8+WH59UrxnfCavLw0OWYjbm8Jd2Y3flB+eL3pH6TMXLu0IJ87gFMUa1UpjnMNqZKrENB/tBrbL+ddIa3oMWGGF8Rvw=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:36.195117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-137ad034-3ce8-4a46-92bf-98d9b0ec8822 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.389782 Sep 07 13:13:36.197647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 153/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:35 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:36.223822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-30d7ab9a-aae9-45be-960b-6919f797a063 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for project fb085890f54a44be94190bd67485bc2b. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:36.255696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-30d7ab9a-aae9-45be-960b-6919f797a063 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for user d5a9fcebd3164b59893658ad92dfcafb and project fb085890f54a44be94190bd67485bc2b. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:36.312243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-30d7ab9a-aae9-45be-960b-6919f797a063 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149798 Sep 07 13:13:36.321040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 152/305] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:13:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:36.329070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:36.329268 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:36.337947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:36.342803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:36.344067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:36.344823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:36.345566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:36.345942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.105868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:37.118510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec20ed92-be3d-4683-ad7b-bbb8da6a8313 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.793381 Sep 07 13:13:37.126492 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 154/306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:36 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:37.220283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:37.220841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:37.240856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.241359 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:37.241799 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.242576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.243257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:37.243692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.441681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:37.451042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fbe8ba56-8c6b-41ac-9f8e-0d018e598265 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.235231 Sep 07 13:13:37.451737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 153/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:37 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:38.142835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:38.143465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:38.150792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.151248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.151866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.152947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.153756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.154347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.227921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032b4561-945c-4a3e-b009-d8d4461ea3d0", "tag": "b2c66196-f64a-466b-8c7c-0e90d6492c4a"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:38.255099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.255798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.256502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.283384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] Creating event network-changed:b2c66196-f64a-466b-8c7c-0e90d6492c4a for instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 on hv-cinder-79053 Sep 07 13:13:38.291484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-ffece07d-514f-4304-95b8-5af1a7c0613a req-b6278442-0f06-459b-88c7-4a52c3e77a3a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067792 Sep 07 13:13:38.293800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 154/308] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:38.479260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:38.479973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:38.488689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.489433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.490030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.490981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:38.491594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.492199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:38.588184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:38.622595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e883e4d2-be3c-4e3f-8905-d5502bb64024 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.483641 Sep 07 13:13:38.623191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 155/309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:38 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:38.754047 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:38.773365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-772dd0df-4198-442b-9f57-871a1087cc2a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.297591 Sep 07 13:13:38.787902 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 155/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:38 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:39.163342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1732753986", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec0a542c-452b-4ff5-aa20-9ab6380517c3"}], "security_groups": [{"name": "tempest-securitygroup--652716206"}], "key_name": "tempest-keypair-1092454450", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:39.349205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] validate_networks() for [('ec0a542c-452b-4ff5-aa20-9ab6380517c3', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:13:39.646660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:39.647939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:39.657933 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.658651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.659247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.661032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.661921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.662393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.857490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:39.870962 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-94b612e3-0abd-46d9-9cef-6e3eefa372a6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.227879 Sep 07 13:13:39.871741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 156/311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:39 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:39.882527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:39.882527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:39.886015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.886924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.887566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.888655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.889480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.890199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.048975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:40.058521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-119e00d9-e70d-47a3-907a-eec5dd4650a3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.185290 Sep 07 13:13:40.070448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 157/312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:39 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:40.355763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:13:40.356778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:13:40.357416 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:13:40.357989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:13:40.358592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:13:40.373202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.375955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.376576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.377510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.380192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.380809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.401940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:40.406272 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Getting quotas for user d5a9fcebd3164b59893658ad92dfcafb and project fb085890f54a44be94190bd67485bc2b. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:40.419772 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:13:40.422101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:13:40.502349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e45df66b-4826-4380-b59b-11c0f78010e9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.344196 Sep 07 13:13:40.509644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 156/313] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:13:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:13:40.514935 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d5b0ad4e-ecbf-4e04-ad6a-40f1a397ca1e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:40.515791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d5b0ad4e-ecbf-4e04-ad6a-40f1a397ca1e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:40.587730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d5b0ad4e-ecbf-4e04-ad6a-40f1a397ca1e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:40.595817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d5b0ad4e-ecbf-4e04-ad6a-40f1a397ca1e tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1246 microversion: 2.1 time: 0.084805 Sep 07 13:13:40.607029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 158/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:40 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:40.904418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:40.904662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:40.911760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.912470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.913396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:40.914273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:40.914930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:40.915518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.102982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2986ff67-fc75-4934-8411-b347f901a26e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Action: 'create', calling method: .version_select at 0x7f7f2b8d1d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-653873450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYjGTXDc/rHObw65uBhDsbaryNSGkVtcFpQ0AWy/J9S13QLT6g2EvX96g6vc5XvIlO6OlUIvj22VrzkpYg1Azx9iyavaZeF7uj42zCPoPl0FQmfZZs+ViTH6Z+r/hf5VA=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:41.122388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-2986ff67-fc75-4934-8411-b347f901a26e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Getting quotas for project a48aa0016c37430b8666cb2a06a29476. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:41.126850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-2986ff67-fc75-4934-8411-b347f901a26e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Getting quotas for user ed2aa1d697a64692bc6a56cb25070c2d and project a48aa0016c37430b8666cb2a06a29476. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:41.143705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:41.155808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4ef600e8-0f32-4ef3-8913-1d3c04a9fda7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.262233 Sep 07 13:13:41.167674 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 157/315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:40 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:41.170226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2986ff67-fc75-4934-8411-b347f901a26e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.271235 Sep 07 13:13:41.171590 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 159/316] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:13:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:41.200928 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:41.201789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:41.216525 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.217223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.217903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.218715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.219196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.219694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.484687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:41.496955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5bfc44a2-863b-4d74-bbf6-c52150e8fefd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.327653 Sep 07 13:13:41.497780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 158/317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:41 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:41.620576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:41.621461 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:41.631340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.632063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.633248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.634365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:41.635016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:41.636113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.737983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:41.748785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-488063be-3b9c-4317-b01f-aa145c955543 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1298 microversion: 2.1 time: 0.132946 Sep 07 13:13:41.749745 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 160/318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:41 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:42.197290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:42.197985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:42.221599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.222104 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.225186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.226190 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.228377 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.230263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.482846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:42.493553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-df6ac923-a091-4fb2-8199-d00c3ced3630 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.301259 Sep 07 13:13:42.504738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 159/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:42 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:42.524963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:42.525757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:42.529687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:42.535594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.536381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.536968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.537817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.539135 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.539913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.738800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:42.748201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-152bc5e6-041f-4b02-ab13-396da0a10d69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.229420 Sep 07 13:13:42.748878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 161/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:42 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:42.773437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:42.774174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:42.781648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.782441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.783303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.784215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.784751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.785906 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.857029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:42.866113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-91e87c9b-07f1-496b-8d81-816ea2cbca41 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1298 microversion: 2.1 time: 0.097234 Sep 07 13:13:42.866743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 160/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:42 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:43.520499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.521131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.527401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.527994 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.528329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.529034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.529605 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.530032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.680388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:43.690119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-242accf4-2edc-4bf2-bf0e-8abf8ca65043 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.173913 Sep 07 13:13:43.706009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 162/322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:43 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:43.772562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.773087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.781029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.781570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.782018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.782786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.783257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.783686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.893136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.893750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:43.902117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.902803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.903633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.904596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:43.905265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:43.906773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:43.981137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:43.990061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-42bb9338-fd24-41fd-adcf-d5ae065311ca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1304 microversion: 2.1 time: 0.100922 Sep 07 13:13:44.018823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 163/323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:43 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:44.118445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:44.126473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0e97aa2d-42b3-426e-b137-1e6a5080fede tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.358046 Sep 07 13:13:44.131363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 161/324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:43 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:44.713789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:44.714434 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:44.721274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.722066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.724480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.725248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.725671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.726133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.915771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:44.923703 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032b4561-945c-4a3e-b009-d8d4461ea3d0", "name": "network-vif-plugged", "status": "completed", "tag": "b2c66196-f64a-466b-8c7c-0e90d6492c4a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:44.924276 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4a928f12-7071-40ec-861f-fc749c1323d0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.214455 Sep 07 13:13:44.932311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 164/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:44 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:44.939086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.940047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.940526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.953607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] Creating event network-vif-plugged:b2c66196-f64a-466b-8c7c-0e90d6492c4a for instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 on hv-cinder-79053 Sep 07 13:13:44.959402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-06ddde7f-b981-43f9-97a8-7f71fa71b92e req-b7d2b9ec-e345-4246-9da2-6b24b5b9092a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040895 Sep 07 13:13:44.960086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 162/326] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:45.026681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.027579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.034952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.036050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.037079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.037890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.039088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.039700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.154733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.156179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.174475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.174954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.175403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.180198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.181557 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.182296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.226733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:45.235146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-af2369c2-49cb-4caa-b0ca-01b4bb781079 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.212204 Sep 07 13:13:45.236097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 165/327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:45.241856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:45.247243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:45.257836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.258546 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.259053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.271780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] Creating event network-changed:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:13:45.276660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-5b53124e-fea5-46e9-aad1-d9e4b526f6c6 req-17776503-992b-4ffd-a223-32a20441364f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039282 Sep 07 13:13:45.277260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 166/328] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:45.357517 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:45.365330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6b905688-f90f-46c5-a3a2-1ce8dc6c78bd tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.219121 Sep 07 13:13:45.365889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 163/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:45.878312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189e8fe6-9341-45da-8284-f59d76578994", "device": "/dev/sdb"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:45.882153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.888667 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.889243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.889771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.890403 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.890892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.891328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.948609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.949233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.956012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.956495 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.956993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.957996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.958570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.958909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.086621 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.095367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-77bd70a3-ef13-4777-b71b-eda7ee4166fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.150436 Sep 07 13:13:46.096194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 164/330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:46.262022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:46.262681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:46.268777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.269260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.269773 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.270751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.271230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.271657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.399832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.407333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f3f9b367-28e0-4f3d-909a-b65919596d23 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.149306 Sep 07 13:13:46.407891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 165/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:46 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:46.413071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:46.413676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:46.420227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.420724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.421214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.421993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:46.422491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:46.422923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:46.562445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.570359 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ef331da3-4f51-4920-989e-d1aa159ee5d4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.161519 Sep 07 13:13:46.570953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 166/332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:46 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:47.118753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.119358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.126572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.127066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.127500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.128204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.128660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.129628 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.266505 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:47.275380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c353ac08-707f-4c4f-a2a6-fa7c136d9df9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1699 microversion: 2.1 time: 0.160669 Sep 07 13:13:47.275970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 167/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:47.298766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:47.305371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.305861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.306340 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.366030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Going to try to start instance {{(pid=120738) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:13:47.380068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:47.410699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-95c5eb39-ef2c-49ff-96f2-e92b52c54bf6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action" status: 202 len: 0 microversion: 2.1 time: 0.115999 Sep 07 13:13:47.411496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 168/334] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:13:47 2022] POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:13:47.420041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.420740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.427631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.428117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.428553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.429245 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.429705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.430129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.652902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:47.661867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7bb2adf7-7cdd-46f2-9958-a4ca1fac15df tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.246041 Sep 07 13:13:47.662453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 169/335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:47.666820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.667426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.669311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:47.674376 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.674893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.675335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.676664 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.677237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.677794 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.833541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b6238cd5-3e75-40ad-ba0a-4db8d49cf52b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "POST /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.960229 Sep 07 13:13:47.834497 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 167/336] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:13:45 2022] POST /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b/os-volume_attachments => generated 194 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:47.839520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.840397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.847007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.847499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.848623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.849454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.849912 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.850336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.944624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:47.952572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7f618ab-fec7-48ed-a07e-906086da4455 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.289161 Sep 07 13:13:47.953358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 170/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:47.998503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:48.007993 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-490c6924-9ed0-4f5c-bb0b-b74859f7c472 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1366 microversion: 2.1 time: 0.172257 Sep 07 13:13:48.008610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 168/338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:48.685670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:48.686290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:48.692835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.693322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.693763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.694478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.694940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.695402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.830014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:48.838846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d0e224ee-b690-495e-a098-c8d760e576cf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.157266 Sep 07 13:13:48.839408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 171/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:48 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:48.975798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:48.976421 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:48.982901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.983386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.983824 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.984511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:48.984966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:48.985388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.002713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:49.031189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.031806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.038390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.038905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.039339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.040028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.040484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.040908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.116320 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:49.124585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-62964c5b-8229-4c2c-8254-54918835385d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.153349 Sep 07 13:13:49.125584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 169/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:48 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:49.172027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:49.180107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e7f33e41-244b-4dca-8d89-0315b34fc386 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1557 microversion: 2.1 time: 0.152675 Sep 07 13:13:49.180694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 172/341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:49.203700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.204354 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.212494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.213105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.213576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.214290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.214785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.215205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.294018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4b183b91-7df4-4b28-8423-50240070b722 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094390 Sep 07 13:13:49.294700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 170/342] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:49.862687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.863522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.870903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.871392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.871835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.872530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.872989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.873417 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.008177 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:50.017205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-96017c02-821d-4512-a384-e8f9bde3b04a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.158410 Sep 07 13:13:50.030435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 173/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:50.149531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:50.150154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:50.156561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.157514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.157514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.158106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.158596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.159020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.535479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032b4561-945c-4a3e-b009-d8d4461ea3d0", "tag": "b2c66196-f64a-466b-8c7c-0e90d6492c4a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:50.543870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.544863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.551947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.553825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.554445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.559022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:50.569397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-33eefef6-c731-4af6-8639-391eb7ba5fc6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.423884 Sep 07 13:13:50.570658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 171/344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:50 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:50.571098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] Creating event network-changed:b2c66196-f64a-466b-8c7c-0e90d6492c4a for instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 on hv-cinder-79053 Sep 07 13:13:50.576208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-a13e1a57-5edd-4b5e-9202-fbb7145584d5 req-83d50284-fa6a-4739-9f6a-5d64534a751a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045591 Sep 07 13:13:50.577001 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 174/345] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:51.041923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.042675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.048622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.049112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.049550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.050243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.050777 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.051211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.137663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=20 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:51.203548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:51.214299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2d3424eb-c05c-4cf7-97d4-46d7b35036da tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.176301 Sep 07 13:13:51.214926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 172/346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:51 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:51.593586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:51.594890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:51.602647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.603135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.603576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.604278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.604737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.605167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.237040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:52.237660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:52.244637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.245393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.245835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.246635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.247094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.247520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.251934 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.261313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a6e7a18-859a-4f07-96eb-2ca761230cde tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.671763 Sep 07 13:13:52.262397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 175/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:51 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:52.386384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.395346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fd13fa5e-f8db-4180-98f0-655851cf7164 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.161914 Sep 07 13:13:52.399843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 173/348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:52 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:53.285411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:53.286012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:53.292511 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.292996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.293434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.294120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.294603 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.295034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.418401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:53.419039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:53.425518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.426010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.426477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.427768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:53.428229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:53.428656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:53.432850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:53.440710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-27b65296-0c0a-4e47-a697-16e0fff01fcf tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.159146 Sep 07 13:13:53.441203 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 176/349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:53 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:53.562407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:53.571311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-dedf2c28-c54b-4f12-92bd-408b67d59981 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1708 microversion: 2.1 time: 0.156769 Sep 07 13:13:53.572134 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 174/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:53 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:54.320005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "name": "network-vif-plugged", "status": "completed", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:54.330132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.330671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.331107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.344176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] Creating event network-vif-plugged:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:13:54.349547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-729dc3b7-305b-4579-b017-004827934505 req-29a7165c-1666-44e6-a9f1-326a94600dfc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033578 Sep 07 13:13:54.350148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 177/351] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:54.464691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:54.465369 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:54.471763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.472252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.472693 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.473382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.473843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.475002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.594881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:54.595582 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:54.602685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.603183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.603632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.604382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.604851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.605282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.608379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:54.616608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-45bf186e-32da-4bc4-a106-797b3ba2ed37 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.155805 Sep 07 13:13:54.617179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 175/352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:54 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:54.740706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:54.749467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62ebdf24-b89d-41d7-ade2-7c2724993f2d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1712 microversion: 2.1 time: 0.158811 Sep 07 13:13:54.750036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 178/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:54 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1712 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:55.639793 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:55.640413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:55.647427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.647915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.648353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.649049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.649511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.649969 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.778503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:55.786029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-77a9c401-5356-4b18-9c73-33e52cee6713 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.150162 Sep 07 13:13:55.787224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 176/354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:55 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:56.809823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:56.810726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:56.817241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:56.817721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:56.818213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:56.819006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:56.819466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:56.819895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:56.961117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:56.968759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-81fbd66a-e802-4264-aa40-4f4d2c06b909 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.162791 Sep 07 13:13:56.969329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 179/355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:56 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:57.992130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:57.992738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:57.999175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.999656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:58.000088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:58.000766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:58.001212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:58.001630 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:58.136531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:58.144740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3b48ca3a-0761-455d-8104-ef005fd15cca tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.157019 Sep 07 13:13:58.145570 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 177/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:57 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:59.168309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:59.168931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:59.175679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.176162 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.176601 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.177318 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:59.177822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:59.178244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:59.305729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:59.314384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fae3f4e6-964c-49b1-9bac-be95ca350f7a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1371 microversion: 2.1 time: 0.149812 Sep 07 13:13:59.315010 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 180/357] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:59 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:00.337746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:00.338353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:00.344805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.345285 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.345717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.346394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.346868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.347289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.478886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:00.486522 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f8a6331b-c642-4004-aaa3-c2747f28ed44 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1566 microversion: 2.1 time: 0.153421 Sep 07 13:14:00.487112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 178/358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:00 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:00.509178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:00.509681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:00.515880 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.516358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.516790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.517465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:00.517915 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:00.518335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:00.600590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f0fc4232-150c-47b7-8be8-6b5a781073c1 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095866 Sep 07 13:14:00.601433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 181/359] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:14:00 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:01.555392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:01.566255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:01.566764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:01.567193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:01.578017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] Creating event network-changed:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:14:01.583141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-2775e566-6737-4a49-b143-2809a0c181c7 req-9f00a6f8-3dad-40ed-822c-aa25e90699bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031371 Sep 07 13:14:01.583946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 179/360] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:24.543018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=23 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:24.543780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:24.545422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:14:24.545643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Wed Sep 7 13:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Sep 07 13:14:24.550530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-334743749", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-653873450", "security_groups": [{"name": "tempest-secgroup-smoke-400146809"}], "networks": [{"uuid": "72c02721-7239-4dfe-8750-85b31aa9318a"}], "block_device_mapping_v2": [{"uuid": "537a3be5-a6f7-4485-bdb2-d4fd9d1c2ad7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:24.671190 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] validate_networks() for [('72c02721-7239-4dfe-8750-85b31aa9318a', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:14:25.043906 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:14:25.044388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:14:25.044645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:14:25.045055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:14:25.045472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:14:25.054166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.054678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.055119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.056840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.056967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.057356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.074724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Getting quotas for project a48aa0016c37430b8666cb2a06a29476. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:25.078869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Getting quotas for user ed2aa1d697a64692bc6a56cb25070c2d and project a48aa0016c37430b8666cb2a06a29476. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:25.134783 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:14:25.136904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='537a3be5-a6f7-4485-bdb2-d4fd9d1c2ad7',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:14:25.249230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=27 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:25.249967 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=56 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:25.254591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:25.255171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:25.262878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.263356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.263786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.264467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:25.264917 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:25.265335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:25.267757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69325fd6-0f44-477b-855f-b4455e62cf0f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726894 Sep 07 13:14:25.268670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 182/361] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:14:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:14:25.279456 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5208031-aaea-46fa-a983-4f4c4c8a5199 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:25.280074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c5208031-aaea-46fa-a983-4f4c4c8a5199 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:25.343514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c5208031-aaea-46fa-a983-4f4c4c8a5199 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:25.351562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5208031-aaea-46fa-a983-4f4c4c8a5199 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1087 microversion: 2.1 time: 0.076013 Sep 07 13:14:25.352353 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 183/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:25 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:25.404983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lazy-loading 'services' on Instance uuid 7d045a3e-061f-4390-8e95-89312d5d134b {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:14:25.526494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-aa2dfac2-0b79-4e3b-953a-d7b010ea865b tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b/os-volume_attachments/189e8fe6-9341-45da-8284-f59d76578994" status: 202 len: 0 microversion: 2.1 time: 0.278123 Sep 07 13:14:25.526817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 180/363] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:14:25 2022] DELETE /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b/os-volume_attachments/189e8fe6-9341-45da-8284-f59d76578994 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:14:26.376129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:26.376771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:26.383746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:26.384228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:26.384668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:26.385437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:26.385899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:26.386327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:26.447752 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:26.455425 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a2982ef3-a830-488a-99c8-233e46914e7f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1129 microversion: 2.1 time: 0.083150 Sep 07 13:14:26.455998 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 184/364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:26 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:27.479374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:27.479977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:27.486088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.486609 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.487049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.487729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:27.488189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:27.488616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:27.553040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:27.561225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c1db8a37-d989-41fe-9582-110aeafbca64 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1129 microversion: 2.1 time: 0.086677 Sep 07 13:14:27.561781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 181/365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:27 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1129 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:28.584372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:28.584985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:28.592219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.592699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.593141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.593822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.594274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.594720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.655724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:28.663268 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fcd2fad1-45b3-44c1-bffd-9862fe0f65b2 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1185 microversion: 2.1 time: 0.082799 Sep 07 13:14:28.663834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 185/366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:28 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:28.778610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:28.779193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:28.785521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.786010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.786478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.787171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.787635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.788063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.814306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:14:28.899114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f37c2e88-ad2e-49ed-b32c-e7e063415e3a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 204 len: 0 microversion: 2.1 time: 0.124721 Sep 07 13:14:28.899884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 182/367] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:14:28 2022] DELETE /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:14:28.908265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:28.909041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:28.914912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.915402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.915842 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:28.916538 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:28.917033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:28.917602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.054693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:29.063073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f73d9537-ca9f-4144-8d7e-b8e4694cab21 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1514 microversion: 2.1 time: 0.158890 Sep 07 13:14:29.063648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 186/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:28 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:29.686814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:29.687766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:29.693662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.694144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.694622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.695302 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:29.695751 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:29.696170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:29.763151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:29.770706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bec66fd8-4ecc-4145-a5c8-f7bda4081245 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1203 microversion: 2.1 time: 0.088562 Sep 07 13:14:29.771265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 183/369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:29 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:30.087292 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:30.087892 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:30.094707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:30.095217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:30.095686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:30.096402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:30.096896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:30.097361 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:30.231790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:30.239344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-43d407e8-4a5e-47c6-82fd-8f014f0c7197 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1514 microversion: 2.1 time: 0.156326 Sep 07 13:14:30.239911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 187/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:30 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:30.793780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:30.794390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:30.800995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:30.801486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:30.801925 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:30.802643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:30.803107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:30.803558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:30.864386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:30.872153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b2508bb8-5eca-4e0c-a306-75fe92255af1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1203 microversion: 2.1 time: 0.082289 Sep 07 13:14:30.872717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 184/371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:30 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1203 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:31.263285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:31.263896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:31.270230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:31.270740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:31.271175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:31.271850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:31.272302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:31.272716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:31.403610 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:31.411336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-89512d2e-983f-4797-8713-ce7e7f6515a2 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1514 microversion: 2.1 time: 0.152574 Sep 07 13:14:31.411912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 188/372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:31 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:31.895318 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:31.895936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:31.902961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:31.903444 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:31.903882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:31.904578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:31.905037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:31.905466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:31.968479 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:31.976487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e8a21f5d-da37-4f13-a9a6-23bbe141c8c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1203 microversion: 2.1 time: 0.084987 Sep 07 13:14:31.985467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 185/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:31 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:32.433797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:32.434340 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:32.441002 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:32.441483 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:32.441919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:32.442643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:32.443125 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:32.443549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:32.725678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:32.734888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-df3152b7-73eb-4515-9524-cc1b1df9e921 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1514 microversion: 2.1 time: 0.304926 Sep 07 13:14:32.735585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 189/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:32 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:33.007784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:33.008216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:33.015918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:33.016526 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:33.017055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:33.017773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:33.018227 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:33.018676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:33.084680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:33.093574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-67855b5c-f77b-4a84-ad5d-b7afded4f9f0 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1203 microversion: 2.1 time: 0.094800 Sep 07 13:14:33.094358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 186/375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:32 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:33.644448 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d045a3e-061f-4390-8e95-89312d5d134b", "name": "network-vif-deleted", "tag": "aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:33.654645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:33.655350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:33.655854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:33.668115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] Creating event network-vif-deleted:aaae4f6f-4484-4a1c-b507-6e9adf3fa6ba for instance 7d045a3e-061f-4390-8e95-89312d5d134b on hv-cinder-79053 Sep 07 13:14:33.673442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-a88b3ce9-4f80-4b3f-9ffc-8f852fbc10d7 req-e3f1d6d9-2fdf-4875-90c0-3bb08e2ec703 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Sep 07 13:14:33.674037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 190/376] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:33.765247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:33.765916 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:33.777636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:33.778161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:33.778628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:33.779527 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:33.779997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:33.780431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:33.851353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:33.860100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-86631f02-a0ad-48ee-9a98-fa00d82f0cf5 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 200 len: 1304 microversion: 2.1 time: 0.104565 Sep 07 13:14:33.860800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 187/377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:33 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:34.116973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:34.117669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:34.124500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.124987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.125420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.126111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.126590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.127015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.321759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:34.330443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7d9904f2-3b4b-4351-864f-f149bf23d57c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.217530 Sep 07 13:14:34.331025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 191/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:34 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:34.884347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:34.884972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 7d045a3e-061f-4390-8e95-89312d5d134b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:34.891484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.891997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.892436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.893131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:34.893592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:34.894018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:34.907915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] HTTP exception thrown: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Request method failure captured: Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b HTTP/1.1 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJjkE8ZIlnFg0kvExmDGJvX5iCmLXBuxlcbEpE6GXZEe8SfZdOuIa42qwTdbuaVw1PyRfBimOLBGgyh0NzPL4QWqBcjLHwFEl7cdsOo3jZQsNy_xfAVnW0UPBXYP3hubGP-Md06_UHHzeXszi3Ndk50jC-o1vckpZk6ZA73ys5XELIc Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 83fb136c97404ff6bdd4e287bed942d3 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:14:34.909574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 83fb136c97404ff6bdd4e287bed942d3 Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesSnapshotTestJSON-1659432264-project Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 6268a000bf92406eb35699ed97711962 Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesSnapshotTestJSON-1659432264-project Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. Sep 07 13:14:34.911249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '7d045a3e-061f-4390-8e95-89312d5d134b'} Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:14:34.912269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. Sep 07 13:14:34.913781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:14:34.915145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Returning 404 to user: Instance 7d045a3e-061f-4390-8e95-89312d5d134b could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:14:34.915145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f5c40e07-e407-4045-9a6c-509deb0c737a tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b" status: 404 len: 111 microversion: 2.1 time: 0.031616 Sep 07 13:14:34.915561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 188/379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:34 2022] GET /compute/v2.1/servers/7d045a3e-061f-4390-8e95-89312d5d134b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:14:35.355372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:35.356080 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:35.358496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:35.359281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:35.365058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:35.365546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:35.365984 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:35.366719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:35.367179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:35.367607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:35.504404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:35.512708 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2472ea51-58f0-4270-9825-35d401dc22ee tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.161508 Sep 07 13:14:35.513284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 192/380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:35 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:35.689489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:35.702082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:35.702607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:35.703048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:35.714878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] Creating event network-changed:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:14:35.720716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-cca86833-586d-41c7-b474-fd147a1a0b39 req-0ae2a06c-074e-4bf1-a873-7ea96e28a344 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 Sep 07 13:14:35.721304 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 189/381] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:14:36.535981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:36.536592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:36.543116 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:36.543596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:36.544030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:36.544720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:36.545172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:36.545595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:36.674754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:36.682432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69398414-389c-4e1f-93c1-710c300b07d8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.150298 Sep 07 13:14:36.683665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 193/382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:36 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:37.706347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:37.707111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:37.714124 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:37.715344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:37.715892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:37.716781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:37.717360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:37.717819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:37.849524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:37.857636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6c34170b-8a5b-4642-9e77-466a7b9fb816 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.155740 Sep 07 13:14:37.858204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 190/383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:37 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:38.879877 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:38.880500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:38.887574 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:38.888063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:38.888503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:38.889209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:38.889665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:38.890086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:39.111863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:39.119546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6f1f234e-28fe-4c26-b4d6-ba855fce7916 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.243494 Sep 07 13:14:39.120109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 194/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:38 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:40.142606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:40.143259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:40.149834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:40.150326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:40.150796 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:40.151515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:40.151968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:40.152396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:40.281496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:40.289109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d7c593a4-8639-4bf8-a515-84617bce490f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.150413 Sep 07 13:14:40.289682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 191/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:40 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:41.312846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:41.313715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:41.320379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:41.320859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:41.321290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:41.321971 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:41.322480 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:41.322903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:41.455899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:41.463556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7713547c-c4e8-4b2c-b50d-f5fae7607c15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.155104 Sep 07 13:14:41.464132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 195/386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:41 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:42.486798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:42.487367 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:42.493782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:42.494268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:42.494752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:42.495449 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:42.495910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:42.496342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:42.634997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:42.643201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2692b30d-6555-41a7-96e4-d367342e04cd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.160426 Sep 07 13:14:42.643805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 192/387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:42 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:43.666931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:43.667531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:43.674297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:43.674818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:43.675253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:43.675965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:43.676417 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:43.676837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:43.816238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:43.823846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d5a14a73-1e24-43f4-aa7e-0aed3c2c4906 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.160851 Sep 07 13:14:43.824415 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 196/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:43 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:44.847365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:44.847985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:44.854365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:44.854898 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:44.855338 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:44.856029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:44.856488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:44.857403 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:44.874667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1820445489", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "networks": [{"uuid": "a06c5c49-3bcd-4c51-a1aa-cf30903a611c"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:44.928766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] validate_networks() for [('a06c5c49-3bcd-4c51-a1aa-cf30903a611c', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:14:44.992068 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:45.000275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cd113e16-938b-4656-9507-063c0e884fcf tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.156721 Sep 07 13:14:45.000842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 193/389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:44 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:45.287951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:14:45.288386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:14:45.288861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:14:45.289272 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:14:45.289682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:14:45.298673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:45.299098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:45.299543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:45.300270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:45.300728 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:45.301157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:45.319973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Getting quotas for project 83fb136c97404ff6bdd4e287bed942d3. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:14:45.324051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Getting quotas for user 6268a000bf92406eb35699ed97711962 and project 83fb136c97404ff6bdd4e287bed942d3. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:14:45.335796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:14:45.338129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:14:45.383713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c1bc4a74-2d95-4a31-af24-0f2b3d4215b9 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513736 Sep 07 13:14:45.384367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 197/390] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:14:45.396616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1df9cd56-0267-4164-a336-ba6fb18858aa tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:45.397232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1df9cd56-0267-4164-a336-ba6fb18858aa tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:45.452462 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1df9cd56-0267-4164-a336-ba6fb18858aa tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:45.459482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1df9cd56-0267-4164-a336-ba6fb18858aa tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1219 microversion: 2.1 time: 0.066803 Sep 07 13:14:45.470442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 194/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:45 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:46.023343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:46.024066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:46.031448 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.031970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.032402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.033098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.033681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.034107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.171057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:46.178820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a044e41-017c-4b1f-bab1-45b22e1d2020 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.159427 Sep 07 13:14:46.179383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 198/392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:46 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:46.484875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:46.485397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:46.492333 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.492810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.493241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.493918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:46.494365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:46.494810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:46.559905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:46.568456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-54f4aa2c-412f-4f30-8f05-cebbabf452c0 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1271 microversion: 2.1 time: 0.088316 Sep 07 13:14:46.569022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 195/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:46 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:47.203067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:47.203650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:47.210207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.210800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.211302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.212136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.212553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.213329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.436354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:47.444988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-989770b8-2b7c-48de-9192-ff839415a217 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.246373 Sep 07 13:14:47.445563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 199/394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:47 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:47.591408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:47.592923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:47.599804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.600322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.600713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.601409 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:47.601867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:47.602652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:47.622748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:47.741450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:47.749465 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-378bfe59-8817-42cc-a8bc-af27cf44e293 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.161921 Sep 07 13:14:47.750061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 196/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:47 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:48.274963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2273d50f-9b71-4f41-a619-8661bee7bd70", "tag": "fde535a8-3c52-4c3f-9778-a6e809ecd5ea"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:48.285717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.286605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.287036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.299322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] Creating event network-changed:fde535a8-3c52-4c3f-9778-a6e809ecd5ea for instance 2273d50f-9b71-4f41-a619-8661bee7bd70 on hv-cinder-79053 Sep 07 13:14:48.304498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-dfdf17aa-2ed1-414a-b94b-42d87aa8ca6f req-7a47d477-e1bb-4d2d-9de7-037fbb5fa557 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033079 Sep 07 13:14:48.305124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 200/396] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:48.469555 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:48.470271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:48.476648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.477225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.477865 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.478766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.479231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.479658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.621990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:48.629856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a290b3b9-3745-4556-bbac-39b5c47d40e8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.165114 Sep 07 13:14:48.630446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 197/397] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:48 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:48.773144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:48.773820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:48.781623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.782112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.782584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.783287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:48.783746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:48.784175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:48.925746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:48.933385 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-86d81e89-3cb6-4f9f-9eba-13200e435d00 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.164579 Sep 07 13:14:48.933954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 201/398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:48 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:49.653224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:49.653872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:49.660707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:49.661214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:49.661699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:49.662457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:49.662965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:49.663398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:49.806202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:49.814393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-80dac3aa-1a76-4c68-8edd-592a67be5a97 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.165030 Sep 07 13:14:49.814972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 198/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:49 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:49.956340 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:49.956874 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:49.963640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:49.964124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:49.964632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:49.965407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:49.965858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:49.966284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:49.971132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:50.097696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:50.105298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dc51a656-aabf-4ed0-84b7-0d8378500bd1 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.152863 Sep 07 13:14:50.105860 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 202/400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:49 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:50.644651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "name": "network-vif-plugged", "status": "completed", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:50.654122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:50.654961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:50.655225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:50.667820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] Creating event network-vif-plugged:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:14:50.673316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-e9c2e332-53cf-448c-a6d4-9781bb0db6a0 req-e363e08c-3022-4132-bb53-999e12cb1e6a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034065 Sep 07 13:14:50.674084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 199/401] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:50.836688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:50.837334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:50.843741 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:50.844236 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:50.844675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:50.845378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:50.845834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:50.846289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:51.098256 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:51.105990 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-92ff3610-37fd-4a35-96af-75c58f8c6406 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.273330 Sep 07 13:14:51.106599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 203/402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:50 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:51.129755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:51.130469 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:51.137283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:51.137777 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:51.138211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:51.138947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:51.139400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:51.139911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:51.281544 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:51.288996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-84b1238e-dfe2-45bc-9fc5-89e178877872 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.163441 Sep 07 13:14:51.289556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 200/403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:51 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:52.129331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:52.129935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:52.136357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:52.136838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:52.137275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:52.137957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:52.138430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:52.138862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:52.273199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:52.281507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6847b19c-6635-45ce-8d00-1b79ccbd0cf7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.156070 Sep 07 13:14:52.282068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 204/404] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:52 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:52.313211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:52.314093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:52.320458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:52.320945 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:52.321390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:52.322076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:52.322561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:52.322991 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:52.454033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:52.461807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6bb7ddd5-6af4-430b-a30c-22d7a3f6fa28 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.152900 Sep 07 13:14:52.462207 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 201/405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:52 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:53.303923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:53.304656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:53.311305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:53.312097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:53.312612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:53.313437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:53.314227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:53.314757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:53.448634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:53.456404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-73d88ee5-c36a-45bc-bfc0-9a7e8f52edba tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1258 microversion: 2.1 time: 0.156294 Sep 07 13:14:53.456988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 205/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:53 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:53.485406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:53.485929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:53.492388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:53.492903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:53.493422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:53.494127 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:53.494786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:53.495217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:53.626661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:53.634187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4898b0b4-ebe0-41dc-8207-bf4a87a64e0c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.153573 Sep 07 13:14:53.634773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 202/407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:53 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:54.480536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:54.481100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:54.487706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.488188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.488624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.489311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.489762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.490184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.627761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:54.636008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7028993-53c3-4357-bd7d-13dada49a567 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1440 microversion: 2.1 time: 0.159413 Sep 07 13:14:54.636688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 206/408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:54 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:54.662400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:54.663493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:54.667276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:54.668155 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:54.671596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.672196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:54.672795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.673501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.674210 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.674713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.675420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.677751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.678243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.678994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.679882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.680331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.680914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.820322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:54.829120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-49978437-2a2e-43b9-bdcd-a79ceb1939db tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.170997 Sep 07 13:14:54.830170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 203/409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:54 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:54.833024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:54.834994 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2273d50f-9b71-4f41-a619-8661bee7bd70", "name": "network-vif-plugged", "status": "completed", "tag": "fde535a8-3c52-4c3f-9778-a6e809ecd5ea"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:54.842147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8cb835fc-fdce-43ef-84b9-72c5d9adceb4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1440 microversion: 2.1 time: 0.178907 Sep 07 13:14:54.846616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:54.847244 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:54.847680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:54.851136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 207/410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:54 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1440 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:14:54.862217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] Creating event network-vif-plugged:fde535a8-3c52-4c3f-9778-a6e809ecd5ea for instance 2273d50f-9b71-4f41-a619-8661bee7bd70 on hv-cinder-79053 Sep 07 13:14:54.867910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-8a054a6f-2f9c-4d8d-93f9-373698b62521 req-5e99dce7-e0e0-4290-8307-c1065e7308c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Sep 07 13:14:54.868900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 204/411] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:55.852992 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:55.853817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:55.855766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:55.856487 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:55.862734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:55.863224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:55.863788 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:55.864498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:55.864970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:55.865375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:55.996050 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:56.005078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a8dfea6d-6a5b-42d9-840c-daa2436d98cd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.155863 Sep 07 13:14:56.005827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 208/412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:55 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:56.535644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:56.540305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:56.545020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:56.552403 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:56.552874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:56.553492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:56.566582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] Creating event network-changed:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:14:56.571266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-6278142c-3929-4c68-9bfb-1b0f384029ad req-feb965b4-8df8-442d-b600-99cd0d647aec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036423 Sep 07 13:14:56.571847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 205/413] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:14:57.028474 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:57.029112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:57.035810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:57.036285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:57.036717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:57.037401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:57.037851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:57.038273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:57.180015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:57.188572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7c6cfd23-719c-4b99-8ebe-dcaf2a8ba0c4 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1319 microversion: 2.1 time: 0.163830 Sep 07 13:14:57.189392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 209/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:57 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:58.216655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:14:58.217501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:58.224070 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.224556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.224995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.225686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.226141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.226766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.362146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:14:58.370459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-354166d8-7ddd-45b6-8287-3c122086e684 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1508 microversion: 2.1 time: 0.158552 Sep 07 13:14:58.371028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 206/415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:14:58 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:14:58.394140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd00c5ae-6024-48fd-ba3b-b474c081afdc", "device": "/dev/sdb"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:14:58.397073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:14:58.403461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.403977 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.404418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.405634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:14:58.406095 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:14:58.406558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:14:58.709011 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1e30e84b-9f82-45bb-87fd-577833b24b6d tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "POST /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319233 Sep 07 13:14:58.709586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 210/416] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:14:58 2022] POST /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:10.126296 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f90acc07-f749-49e9-b374-98eb85ffe2f7"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:10.128627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:10.131295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:10.131945 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=50 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:10.137736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:10.138224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:10.138695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:10.139390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:10.139843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:10.140770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.996927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-302abedf-b858-4093-9aa1-1b4bf7d97073 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.874651 Sep 07 13:15:11.997566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 207/417] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:15:10 2022] POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments => generated 194 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:12.197338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:12.197840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:12.200461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=7 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:12.201583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:12.208208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:12.208725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:12.209230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:12.209933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:12.210391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:12.210845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:12.341740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lazy-loading 'services' on Instance uuid 04e96a0f-85ee-4d00-b876-e7bf7d4547db {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:12.454823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6657aa1-1286-4306-9ff2-5dc987deda33 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments/5ec45c12-ab38-4df0-8c64-4434b24265c0" status: 202 len: 0 microversion: 2.1 time: 0.261554 Sep 07 13:15:12.455446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 211/418] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:15:12 2022] DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments/5ec45c12-ab38-4df0-8c64-4434b24265c0 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:12.967724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:12.968712 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:12.975427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:12.975909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:12.976346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:12.977029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:12.977487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:12.977911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.001286 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b8c31d04-1bad-412c-ab87-f642e7689b58 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/ips" status: 200 len: 151 microversion: 2.1 time: 0.038188 Sep 07 13:15:13.001912 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 208/419] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:15:12 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:13.013816 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7df9efa0-0238-4ffb-8178-cb042253d0a1"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:13.016878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.023364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.023841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.024275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.024992 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.025443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.025867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.105005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/os-volume_attachments HTTP/1.1 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 74 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:15:13.106758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {"volumeAttachment": {"volumeId": "7df9efa0-0238-4ffb-8178-cb042253d0a1"}} Sep 07 13:15:13.108160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'server_id': '032b4561-945c-4a3e-b009-d8d4461ea3d0', 'body': {'volumeAttachment': {'volumeId': '7df9efa0-0238-4ffb-8178-cb042253d0a1'}}} Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.109611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:13.111076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 400 to user: Invalid volume: volume 7df9efa0-0238-4ffb-8178-cb042253d0a1 is already attached to instances: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b1b1b375-e997-4022-b815-902447efeae7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098746 Sep 07 13:15:13.112247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 212/420] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:15:13 2022] POST /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:15:13.117785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:13.118293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.125457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.125977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.126436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.127140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.127600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.128035 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.153386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:15:13.229387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a1016edd-18c4-42d6-9919-9e7239834606 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 204 len: 0 microversion: 2.1 time: 0.114980 Sep 07 13:15:13.229880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 209/421] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:15:13 2022] DELETE /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:15:13.238686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:13.239298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:13.246139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.246653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.247094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.247786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:13.248242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:13.248669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:13.385183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:13.392953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1bf1afd7-23a8-437f-8d12-e120cfa7624a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.158801 Sep 07 13:15:13.393518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 213/422] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:13 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:14.416603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:14.417211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:14.424700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:14.425178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:14.425611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:14.426289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:14.426773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:14.427195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:14.559432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:14.567689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb47f3b9-29a8-4c0e-a7eb-6bc4be816671 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.155393 Sep 07 13:15:14.568566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 210/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:14 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:15.591489 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:15.592034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:15.599181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:15.599700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:15.600136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:15.600833 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:15.601292 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:15.601720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:15.732743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:15.740461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-64f69574-d628-4ca0-a40f-c6553c48d329 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.153051 Sep 07 13:15:15.741024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 214/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:15 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:16.764009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:16.764627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:16.771374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:16.771854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:16.772290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:16.772973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:16.773429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:16.773853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:16.901493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:16.909556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a3931563-6c1d-495c-b440-177d8357a7c4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.149388 Sep 07 13:15:16.910119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 211/425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:16 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:17.933103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:17.933720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:17.941211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:17.941991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:17.942151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:17.943038 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:17.943726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:17.944175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:18.087713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:18.096746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9656ac6-8711-4a6d-993e-a33d7f6db3e1 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.167433 Sep 07 13:15:18.097322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 215/426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:17 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:19.120435 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:19.121187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:19.128225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:19.128709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:19.129157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:19.129854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:19.130313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:19.130784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:19.265893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:19.274281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0e9fe15f-4edf-45bb-a9ae-b140e51f1673 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.157538 Sep 07 13:15:19.274899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 212/427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:19 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:20.297286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:20.297988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:20.304270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:20.304745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:20.305227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:20.305916 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:20.306367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:20.306881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:20.581632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:20.590047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-67679b95-fab0-4c80-b862-649c0a75fdc2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1682 microversion: 2.1 time: 0.296489 Sep 07 13:15:20.590750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 216/428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:20 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1682 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:21.159518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032b4561-945c-4a3e-b009-d8d4461ea3d0", "name": "network-vif-deleted", "tag": "b2c66196-f64a-466b-8c7c-0e90d6492c4a"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:21.173896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.174582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.175174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.189624 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] Creating event network-vif-deleted:b2c66196-f64a-466b-8c7c-0e90d6492c4a for instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 on hv-cinder-79053 Sep 07 13:15:21.195661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-badcd03e-2b56-439c-b7a8-4eb03408fa74 req-532bb2b0-07f4-4672-a132-55a5fa90bae8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 Sep 07 13:15:21.196930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 213/429] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:21.282936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:21.283439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:21.289777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.290262 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.290725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.291418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.291880 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.292304 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.389305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lazy-loading 'services' on Instance uuid 2273d50f-9b71-4f41-a619-8661bee7bd70 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:21.472256 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-84b5a7ee-4dac-48b9-aa6f-81133cb5640c tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70/os-volume_attachments/dd00c5ae-6024-48fd-ba3b-b474c081afdc" status: 202 len: 0 microversion: 2.1 time: 0.193604 Sep 07 13:15:21.473010 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 217/430] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:15:21 2022] DELETE /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70/os-volume_attachments/dd00c5ae-6024-48fd-ba3b-b474c081afdc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:21.614361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:21.615128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:21.625201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.627397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.628965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.629849 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.632757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.633737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.690701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:21.691693 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:21.692226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:21.692770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'fault' on Instance uuid 032b4561-945c-4a3e-b009-d8d4461ea3d0 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:21.738719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:21.747147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-535c7fa6-5f39-4136-b4ff-196732fbe50f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 200 len: 1330 microversion: 2.1 time: 0.137762 Sep 07 13:15:21.749088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 214/431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:21 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:22.772885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:22.773733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:22.780008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:22.780420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:22.780861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:22.781548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:22.782092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:22.782618 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:22.796970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 HTTP/1.1 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:15:22.798588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:15:22.800169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '032b4561-945c-4a3e-b009-d8d4461ea3d0'} Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:22.801062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:15:22.802595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:15:22.803947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:22.803947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5e342319-1d75-47f3-836e-41b5ec83de4f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 404 len: 111 microversion: 2.1 time: 0.031952 Sep 07 13:15:22.804111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 218/432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:22 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:22.809189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5e1669a8-86a8-4f13-8173-08e25bb7509b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '.version_select at 0x7f7f2b731160>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:22.830009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5e1669a8-86a8-4f13-8173-08e25bb7509b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796993315" status: 202 len: 0 microversion: 2.1 time: 0.024578 Sep 07 13:15:22.830889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 215/433] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Sep 7 13:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796993315 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:23.509609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:23.510110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:23.516881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:23.517716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:23.518464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:23.519541 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:23.520004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:23.520666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:23.602267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'services' on Instance uuid a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:23.672327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dc0b3c27-1a43-4d0a-8a30-9bcbe66df5f7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments/7df9efa0-0238-4ffb-8178-cb042253d0a1" status: 202 len: 0 microversion: 2.1 time: 0.167735 Sep 07 13:15:23.673765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 219/434] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:15:23 2022] DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments/7df9efa0-0238-4ffb-8178-cb042253d0a1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:23.683066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:23.686137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:23.693904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:23.694272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:23.694890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:23.695796 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:23.696050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:23.696480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:23.727703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e9881d89-1b3b-46b7-9db3-871de81b70ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049484 Sep 07 13:15:23.728267 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 216/435] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:23 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:24.742004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:24.744612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:24.759058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:24.759058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:24.759058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:24.759058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:24.759408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:24.759408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:24.784648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0f3fad77-27fd-4b4b-8456-59d2b5f58de7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Sep 07 13:15:24.789232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 220/436] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:24 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:25.796931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:25.799260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:25.805670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:25.806140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:25.806615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:25.807307 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:25.807886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:25.808307 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:25.837816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-564b689a-b1aa-44bf-8fae-cff1c806500f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Sep 07 13:15:25.838425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 217/437] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:25 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:26.850918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:26.854470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:26.861859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:26.862974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:26.863542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:26.864252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:26.864789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:26.865216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:26.898576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9058ed83-6b84-4dca-b9ba-d2ff6c524c4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051540 Sep 07 13:15:26.899157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 221/438] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:26 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:27.010774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:27.012929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:27.019399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.019880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.020309 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.020990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.021437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.021854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.044334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'flavor' on Instance uuid 8263f5a1-67f2-48a7-8b3a-518e97db6455 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:27.165512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-449519b5-f593-4ee2-9b89-62b86941054f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/action" status: 200 len: 32 microversion: 2.1 time: 0.158835 Sep 07 13:15:27.166107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 218/439] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:15:27 2022] POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:15:27.175895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:27.176502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:27.182408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.182920 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.183357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.184038 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.184531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.184958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.318851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:27.327200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0483a16a-44a1-4490-bad5-b80498703064 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.155359 Sep 07 13:15:27.327776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 222/440] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:27 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:27.911807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:27.914030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:27.920166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.920655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.921094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:27.922249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:27.922709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:27.955978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-017c51bf-b298-424f-8768-d0fb66221c38 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048835 Sep 07 13:15:27.960593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 219/441] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:27 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:28.350330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:28.351002 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:28.357406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.358203 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.358677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.359372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.359830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.360261 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.420268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:28.428078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.428577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.429018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.432614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:28.453469 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Going to try to stop instance {{(pid=120737) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:15:28.493633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:28.496221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1291b5cb-4051-4628-9af8-b6a8ec4f4972 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action" status: 202 len: 0 microversion: 2.1 time: 0.079619 Sep 07 13:15:28.496834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 220/442] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:15:28 2022] POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:15:28.503773 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2ee1cdcf-b7da-46ad-9856-2274bd8d0358 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.157439 Sep 07 13:15:28.504352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 223/443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:28 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:28.504997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:28.505695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:28.511735 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.512218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.512655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.513345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.513800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.514228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.651160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:28.659471 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f454a858-b9fe-4684-8653-cb28ec8c654b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1722 microversion: 2.1 time: 0.158459 Sep 07 13:15:28.660123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 221/444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:28 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:28.968364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:28.970534 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:28.976631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.977110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.977537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:28.978221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:28.978696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:28.979144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:29.009400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6bb0f11b-c70a-4941-b96f-379ee11f038b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Sep 07 13:15:29.009964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 224/445] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:28 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:29.526830 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:29.527450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:29.535323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:29.535813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:29.537039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:29.538364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:29.539373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:29.539808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:29.674253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:29.681660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:29.682281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:29.682652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-32ee7c58-0006-4d33-97c6-bb12c6590450 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.159553 Sep 07 13:15:29.683227 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 222/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:29 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:29.689134 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:29.689627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:29.690066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:29.690798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:29.691259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:29.691939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:29.829085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:29.837610 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b2e0f97c-b759-451f-8569-8a8d5ba47191 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.160000 Sep 07 13:15:29.838166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 225/447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:29 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:30.023284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:30.025719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:30.032871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.033295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.033726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.034536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.034990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.035440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.065982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e77d34e8-e62a-4d5d-9e94-2a8ae89bbd90 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Sep 07 13:15:30.066825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 223/448] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:30 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:30.706260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:30.707014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:30.713057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.713545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.713984 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.714710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.715173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.715602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.720529 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:30.862162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:30.862889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:30.870104 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.870755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.871254 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.872086 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:30.872732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:30.873356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:30.909592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:30.918157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62ef3cb2-88e6-455c-ada7-60fc5bc59ec3 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.215640 Sep 07 13:15:30.918776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 226/449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:30 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:31.078183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:31.081101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:31.087311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.087804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.088240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.088943 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.089398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.089822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.123641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1aeaa0de-dc36-44fa-8d7a-f7b667bab804 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049459 Sep 07 13:15:31.129463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 227/450] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:31 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:15:31.161136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:31.161737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:31.167948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.168432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.168900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.169584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.170033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.170485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.196722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:15:31.234717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:31.242867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7afb5c72-8037-4a75-b99b-84a6a4454463 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.385314 Sep 07 13:15:31.243443 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 224/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:30 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:31.275995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b312ca96-d2b4-478e-8aff-cbb2893e3a64 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 204 len: 0 microversion: 2.1 time: 0.119060 Sep 07 13:15:31.276573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 228/452] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:15:31 2022] DELETE /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:15:31.285415 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:31.286133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:31.292165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.292654 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.293095 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.293786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.294243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.294727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.425010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:31.433150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9df332b1-aeba-4677-937b-95168b395712 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1560 microversion: 2.1 time: 0.152275 Sep 07 13:15:31.433720 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 225/453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:31 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:31.943121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:31.943819 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:31.950243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.950819 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.951316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:31.952035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:31.952490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:31.952918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.082776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:32.090874 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a04e8b92-b215-4199-81d5-7f9959cbc577 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.152828 Sep 07 13:15:32.091443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 229/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:31 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:32.136170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:32.138476 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:32.144895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.145382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.145819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.146529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.146992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.147414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.177272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9498f5cb-8a44-43f8-bece-fcd438653a94 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Sep 07 13:15:32.177860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 226/455] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:32 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:32.265174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:32.265790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:32.271765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.272247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.272685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.273371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.273825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.274246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.405753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:32.413899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9eda912c-7448-4a84-a36e-0657f736c3d6 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.152676 Sep 07 13:15:32.414480 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 230/456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:32 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:32.457440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:32.457981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:32.463886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.464374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.464838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.465524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:32.465983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:32.466409 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:32.594885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:32.603115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1007b538-ad8d-4ae4-81c3-90df8a23a6fd tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1514 microversion: 2.1 time: 0.150034 Sep 07 13:15:32.603679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 227/457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:32 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:33.113549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:33.114160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:33.120639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.121121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.121557 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.122241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.122718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.123142 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.190100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:33.192571 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:33.198975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.199457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.199895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.200583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.201039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.204281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.235365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ca1b458a-8ca6-4593-bf5a-dffe2e7055b6 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050027 Sep 07 13:15:33.236555 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 228/458] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:33 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:15:33.255517 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:33.263606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03f9b49e-1f9d-4185-899b-38531601c972 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.154140 Sep 07 13:15:33.264171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 231/459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:33 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:33.440434 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:33.440434 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:33.445184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.445674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.446402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.446858 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.447365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.447760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.575839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:33.583611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2ba8425f-1c8f-44f6-8eb1-a04c4b546387 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.149863 Sep 07 13:15:33.584172 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 229/460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:33 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:33.625592 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:33.626233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:33.634381 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.634892 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.635336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.636027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:33.636479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:33.636904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:33.779693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:33.787799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9963a05f-1cd2-4515-a3f0-e9494b7e63ee tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1514 microversion: 2.1 time: 0.165941 Sep 07 13:15:33.788373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 232/461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:33 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:34.249097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:34.251274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:34.258233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.258892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.259335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.260029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.260491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.260922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.287432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:34.288172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:34.289919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2206ef54-59f2-416d-b84f-3546abbd7a51 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Sep 07 13:15:34.290533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 230/462] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:34 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:34.295952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.296440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.296875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.297570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.298024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.299258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.503197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:34.511767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ab375219-000f-4af1-af31-49c44eaa3182 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.228390 Sep 07 13:15:34.512336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 233/463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:34 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:34.608509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:34.609118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:34.615817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.616304 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.616744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.617459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.617915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.618339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.754103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:34.761655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1778e184-dede-4364-bc83-25d738c0c45e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.157026 Sep 07 13:15:34.762216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 231/464] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:34 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:34.810755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:34.811359 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:34.817781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.818252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.818714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.819383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:34.819835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:34.820248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:34.952191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:34.960311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-155d5d48-5cc8-4e4d-8f04-a9575278e027 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1514 microversion: 2.1 time: 0.153303 Sep 07 13:15:34.961163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 234/465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:34 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:35.302535 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:35.304672 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:35.310989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.311478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.311917 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.312603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.313062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.313488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.344147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a2a08487-09a6-4c56-8236-71e9349ac01f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Sep 07 13:15:35.344703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 232/466] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:35 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:35.534947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:35.535566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:35.541924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.542408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.542881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.543571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.544029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.544457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.786048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:35.786663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:35.792855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.793392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.793835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.794563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.795026 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:35.795452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:35.928713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:35.936431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b6109363-2474-4f35-be48-26ed080357a9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.155210 Sep 07 13:15:35.937000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 233/467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:35 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:35.984408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:35.985031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:35.999351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:35.999844 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.000278 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.000973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.001422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.002653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.015255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:36.025371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-96ef4409-2187-465a-b075-385c7ace1b5c tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.494576 Sep 07 13:15:36.026158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 235/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:35 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:36.146669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:36.154434 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1c375293-6caa-4536-b3c1-ceeea27a83ca tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1514 microversion: 2.1 time: 0.173848 Sep 07 13:15:36.155008 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 234/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:35 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:36.289331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2273d50f-9b71-4f41-a619-8661bee7bd70", "name": "network-vif-deleted", "tag": "fde535a8-3c52-4c3f-9778-a6e809ecd5ea"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:36.299452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.299857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.300285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.311365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] Creating event network-vif-deleted:fde535a8-3c52-4c3f-9778-a6e809ecd5ea for instance 2273d50f-9b71-4f41-a619-8661bee7bd70 on hv-cinder-79053 Sep 07 13:15:36.317343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-3a355ed0-bc74-4dca-ad87-74ddec2b0468 req-80acda08-5a83-4ea8-9c19-143388314dbb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031364 Sep 07 13:15:36.317938 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 236/470] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:36.356843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:36.358982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:36.366431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.366931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.367368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.368059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.368510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.368932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.405476 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:36.411221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-24ae909f-777f-4d11-a04b-8cda24790f1e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058330 Sep 07 13:15:36.411790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 235/471] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:15:36 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:15:36.632615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:36.633212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:36.639348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.639837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.640278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.640964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.641421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.641848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.667562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:15:36.745686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7985c3b0-271d-4f33-bae7-4ee2d3727d40 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 204 len: 0 microversion: 2.1 time: 0.117623 Sep 07 13:15:36.746265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 237/472] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:15:36 2022] DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:15:36.755396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:36.756208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:36.763714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.764294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.764809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.765577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.766135 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.766702 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.952077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:36.960512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2b10bed4-788b-49f4-b481-6f3d53720b69 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1681 microversion: 2.1 time: 0.209988 Sep 07 13:15:36.960764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:36.961088 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 236/473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:36 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:36.961473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:36.967352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.967846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.968285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:36.968974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:36.969430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:36.969854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.049097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:37.049716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:37.055730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.056220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.056661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.057368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.057806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.058232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.101202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:37.109115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1cb39a93-cf3c-428e-9eac-477721867b55 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.152540 Sep 07 13:15:37.109769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 238/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:36 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:37.177092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:37.178322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:37.184289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.184781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.185213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.185903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.186352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.186542 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:37.186799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.194904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3f75f3ed-e4d8-4da4-a407-66efafd70343 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.149898 Sep 07 13:15:37.195466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 237/475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:37 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:37.218165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.218688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.219127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.219569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lazy-loading 'fault' on Instance uuid 2273d50f-9b71-4f41-a619-8661bee7bd70 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:37.266735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:37.271208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:37.276124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d0424f28-252e-48cd-ab83-d02ee3662922 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1309 microversion: 2.1 time: 0.102879 Sep 07 13:15:37.276689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 239/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:37 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:37.984322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:37.984931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:37.991343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.991821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.992251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:37.992926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:37.993374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:37.993793 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.133595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:38.134220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:38.135098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:38.143716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.143953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6c7dfaba-1187-452c-b465-27029413dfb2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1681 microversion: 2.1 time: 0.163301 Sep 07 13:15:38.144193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.144632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.144996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 238/477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:37 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:38.145628 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.146150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.146616 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.223101 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:38.223781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:38.229930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.230447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.230896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.231584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.232042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.232549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.334968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:38.342913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bf47e2da-68b8-43d2-b625-6870ad04862d tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.213857 Sep 07 13:15:38.343642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 240/478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:38 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:38.348150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:38.349174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:38.354391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.354929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.355362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.356043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.356490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.357210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.367103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:38.375247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-129212aa-878e-4a64-afd0-4ddfb83b0afe tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.156229 Sep 07 13:15:38.375853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 239/479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:38 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:38.391308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:38.392112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:38.393233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:38.393676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lazy-loading 'fault' on Instance uuid 2273d50f-9b71-4f41-a619-8661bee7bd70 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:38.435562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:38.444610 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a09ea284-6885-47b0-bfcd-91480a3bd182 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1309 microversion: 2.1 time: 0.099971 Sep 07 13:15:38.445216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 241/480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:38 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:39.171780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:39.172540 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:39.179247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.179739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.180179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.180870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.181328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.181760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.311001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:39.320052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4648d451-0430-46a1-b623-b450b6f31a4a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1681 microversion: 2.1 time: 0.152274 Sep 07 13:15:39.320609 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 240/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:39 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:39.365759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:39.366369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:39.372718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.373200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.373633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.374319 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.374798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.375221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.400945 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:39.401785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:39.407729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.408217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.408738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.409775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.410243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.410698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.510462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:39.519400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-83c70639-728b-4a02-8cb3-af1023912be4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.157889 Sep 07 13:15:39.519987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 242/482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:39 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:39.524507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:39.525117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:39.530921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.531414 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.531854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.532553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.533018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.533482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.553781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:39.561920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-aa8abcd9-8d0e-43fd-b340-6a1100ffd63a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.164726 Sep 07 13:15:39.562512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 241/483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:39 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:39.565583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:39.566073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:39.566529 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:39.566983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lazy-loading 'fault' on Instance uuid 2273d50f-9b71-4f41-a619-8661bee7bd70 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:15:39.608148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6268a000bf92406eb35699ed97711962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb136c97404ff6bdd4e287bed942d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:39.616814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4a8b0a5d-f426-4828-b278-a324802f1596 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 200 len: 1309 microversion: 2.1 time: 0.095807 Sep 07 13:15:39.617385 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 243/484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:39 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:40.343279 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:40.343906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:40.347154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:40.352488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.352979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.353416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.354143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.354627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.355057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.483676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:40.491924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-96564dc9-a805-4199-ac92-de020d7b804f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1681 microversion: 2.1 time: 0.152561 Sep 07 13:15:40.492492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 242/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:40 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:40.542807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:40.543491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:40.550944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.551437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.551873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.552580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.553036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.553459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.585884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:40.586651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:40.593249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.593249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.593727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.594567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.595629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.595629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.739845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:40.748128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d8591175-d6f4-4c9d-a6c1-c297b6cfda5d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.165987 Sep 07 13:15:40.748700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 243/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:40 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:40.753347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:40.753961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] [instance: 2273d50f-9b71-4f41-a619-8661bee7bd70] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:40.759608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.760094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.760532 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.761221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:40.761680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:40.762107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:40.776538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] HTTP exception thrown: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Request method failure captured: Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 HTTP/1.1 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJjkE8ZIlnFg0kvExmDGJvX5iCmLXBuxlcbEpE6GXZEe8SfZdOuIa42qwTdbuaVw1PyRfBimOLBGgyh0NzPL4QWqBcjLHwFEl7cdsOo3jZQsNy_xfAVnW0UPBXYP3hubGP-Md06_UHHzeXszi3Ndk50jC-o1vckpZk6ZA73ys5XELIc Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 83fb136c97404ff6bdd4e287bed942d3 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:15:40.778178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/83fb136c97404ff6bdd4e287bed942d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 83fb136c97404ff6bdd4e287bed942d3 Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1659432264 Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesSnapshotTestJSON-1659432264-project Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 6268a000bf92406eb35699ed97711962 Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesSnapshotTestJSON-1659432264-project Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. Sep 07 13:15:40.779800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '2273d50f-9b71-4f41-a619-8661bee7bd70'} Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:40.780694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. Sep 07 13:15:40.782190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:40.784274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] Returning 404 to user: Instance 2273d50f-9b71-4f41-a619-8661bee7bd70 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:40.784274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a22b435f-6fc7-48d5-b174-711ca45d9d93 tempest-VolumesSnapshotTestJSON-1659432264 tempest-VolumesSnapshotTestJSON-1659432264-project] 10.222.0.65 "GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70" status: 404 len: 111 microversion: 2.1 time: 0.030026 Sep 07 13:15:40.784274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 244/487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:40 2022] GET /compute/v2.1/servers/2273d50f-9b71-4f41-a619-8661bee7bd70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:40.804670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:40.813276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2c988d82-c3a8-4977-a5ca-6eafb1f5fdbc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.275004 Sep 07 13:15:40.813849 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 244/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:40 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:41.475860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c", "name": "network-vif-deleted", "tag": "6b808cc9-08ba-42d0-9e09-79b6c1566f01"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:41.487112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.487312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.487590 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.498638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] Creating event network-vif-deleted:6b808cc9-08ba-42d0-9e09-79b6c1566f01 for instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c on hv-cinder-79053 Sep 07 13:15:41.509015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-5c44e166-5c37-4a6d-8006-7845afe94a76 req-fbce41a3-99fb-47c5-bc49-ac9d74fa4d44 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036826 Sep 07 13:15:41.510622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 245/489] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:41.516152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:41.516933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:41.525907 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.526529 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.527128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.528025 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.528490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.528917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.604077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:41.613979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8a54c534-f397-4dc7-b768-41da4706b575 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 200 len: 1325 microversion: 2.1 time: 0.103065 Sep 07 13:15:41.614775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 245/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:41 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:41.773195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:41.774126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:41.780049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.780533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.780964 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.781650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.782101 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.782548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.837385 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:41.837996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:41.844390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.845285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.846001 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.848057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:41.848670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:41.849248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:41.933538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:41.943024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1621757a-62b1-49f4-a53f-c978f81118bd tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.174317 Sep 07 13:15:41.943868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 246/491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:41 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:42.014859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:42.023666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb4b5fd2-5db2-4d53-b301-22c5894b04bf tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.190486 Sep 07 13:15:42.024241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 246/492] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:41 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:42.638939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:42.639563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:42.646027 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:42.646623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:42.647074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:42.647768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:42.648231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:42.648662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:42.662981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c HTTP/1.1 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:15:42.664612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:15:42.666140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c'} Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:42.667054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:15:42.668490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:42.669817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:42.669817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7ae4b9b8-7688-4172-9954-d6f4392f1f63 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 404 len: 111 microversion: 2.1 time: 0.031014 Sep 07 13:15:42.669817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 247/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:42 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:42.675644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ba0d0d45-bf58-4332-a417-12fc6b9e39ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '.version_select at 0x7f7f2b67a160>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:42.685662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:42.700293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ba0d0d45-bf58-4332-a417-12fc6b9e39ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983455319" status: 202 len: 0 microversion: 2.1 time: 0.029154 Sep 07 13:15:42.700885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 247/494] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Sep 7 13:15:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983455319 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:42.968077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:42.968573 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:42.975157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:42.975638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:42.976072 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:42.976759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:42.977211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:42.977631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:43.047324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:43.048143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:43.055168 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:43.055658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:43.056094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:43.056791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:43.057244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:43.057671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:43.161228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:43.169740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-29aed312-4244-451a-a303-97e4d4588474 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.205384 Sep 07 13:15:43.179553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 248/495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:42 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:43.191701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:43.200035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5718f70e-3689-484e-b11a-75d60fea4e19 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.156658 Sep 07 13:15:43.200611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 248/496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:43 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:43.407791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd9e9470-4b97-4161-9d09-2c44f47a6acc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: .version_select at 0x7f7f2b721f70>, body: {"keypair": {"name": "tempest-keypair-486084023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbiqWjFQQ8tRzqWy+t4duiTG0r5EYGFOLz8LE/T+BgMAflpp9xgg3SQ0rnn6qqCbD1U3TH7gyhG+tATRZfwaefZIpUtdH+MORdL41aku8r/YJ7wRT+vXS1SlWlKhSwOw=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:43.422998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-bd9e9470-4b97-4161-9d09-2c44f47a6acc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:15:43.427021 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-bd9e9470-4b97-4161-9d09-2c44f47a6acc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:15:43.450266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bd9e9470-4b97-4161-9d09-2c44f47a6acc tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046332 Sep 07 13:15:43.450881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 249/497] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:15:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:44.193256 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:44.193982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:44.200522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:44.201008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:44.201456 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:44.202167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:44.202657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:44.203189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:44.224683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:44.225826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:44.233234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:44.233728 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:44.234171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:44.234923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:44.235384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:44.235808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:44.345379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:44.358917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cbc6222f-a4b4-4369-afa1-ff3c33f610e4 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.169946 Sep 07 13:15:44.359717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 249/498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:44 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:44.437069 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:44.445246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fc599e41-4ce2-4c03-bc47-d470891a0e60 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.225047 Sep 07 13:15:44.445821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 250/499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:44 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:44.824922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-726313404", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be10bb5-1b7b-48d3-b1b4-958b66e89a40"}], "security_groups": [{"name": "tempest-securitygroup--700838059"}], "key_name": "tempest-keypair-486084023", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:44.926320 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] validate_networks() for [('0be10bb5-1b7b-48d3-b1b4-958b66e89a40', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:15:45.298641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:15:45.299158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:15:45.300145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:15:45.300684 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:15:45.301099 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:15:45.309965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.310475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.310921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.311645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.312102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.312526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.329990 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:15:45.334233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:15:45.345549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:15:45.348026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:15:45.383349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:45.383966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:45.389916 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.390383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.391064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.391753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.392371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.392801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.398492 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3d7e7d8c-2f95-4443-8545-6a4b0a91c150 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577734 Sep 07 13:15:45.399091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 250/500] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:15:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:15:45.410115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5432a38e-afbf-4e5f-bc54-eb8dfb37d537 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:45.410743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5432a38e-afbf-4e5f-bc54-eb8dfb37d537 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:45.473073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5432a38e-afbf-4e5f-bc54-eb8dfb37d537 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:45.481271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5432a38e-afbf-4e5f-bc54-eb8dfb37d537 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1240 microversion: 2.1 time: 0.074936 Sep 07 13:15:45.482797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 251/501] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:45 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:45.490919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:45.491537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:45.501352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.501857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.502330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.503777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:45.504241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:45.504675 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:45.561588 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:45.571164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ddc81bc3-c1fd-4f79-9f1f-4225e70eaca2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.191674 Sep 07 13:15:45.582555 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 251/502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:45 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:45.653302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:45.663017 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-43a2b2f1-6d66-4763-bf7c-24b04b2236c2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.177960 Sep 07 13:15:45.664292 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 252/503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:45 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:46.505450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:46.506067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:46.512432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.512911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.513346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.514036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.514510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.514929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.584374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:46.593778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cddb211a-ec19-41dc-b564-8d199f6d835a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1292 microversion: 2.1 time: 0.092552 Sep 07 13:15:46.594378 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 252/504] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:46 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:46.601701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:46.602459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:46.609199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.609889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.610336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.611072 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.611535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.611964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.687690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:46.688657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:46.695308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.695814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.696257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.696970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:46.697608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:46.698041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:46.805001 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:46.813886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b1d9a85e-a3d1-4563-be82-16b3614dd39a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.223204 Sep 07 13:15:46.814500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 253/505] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:46 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:46.871944 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:46.879631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-dc37c704-0f2a-4b4c-a8b0-4285e6a2bbde tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.196584 Sep 07 13:15:46.880202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 253/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:46 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:47.617566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:47.618215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:47.624283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.624768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.625208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:47.625899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.626358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.626814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:47.688513 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:47.696415 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-305dc2da-ad46-4abd-82c1-cba71abfab05 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1298 microversion: 2.1 time: 0.082666 Sep 07 13:15:47.696982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 254/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:47 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:47.838365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:47.839110 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:47.847355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.847908 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.848564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:47.849518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.850170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.850836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:47.911506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:47.912140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:47.928136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.928769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.929217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:47.929920 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:47.930374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:47.931015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:48.029361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:48.039400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d86ff734-9fe3-446e-aced-1949601c9d90 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.204779 Sep 07 13:15:48.039972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 254/508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:47 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:48.154144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:48.162180 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5a52651-90fb-49e2-a201-f07642c0c865 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.259499 Sep 07 13:15:48.162786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 255/509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:47 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:48.720864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:48.721488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:48.729407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:48.729903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:48.730342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:48.731082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:48.731541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:48.731968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:48.752244 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:48.870095 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:48.877848 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d0f7095b-8e22-4f9a-b970-135a5d1a52d9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.160876 Sep 07 13:15:48.878478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 255/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:48 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:49.057609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcd7087-bcdc-489b-8ba6-d784b65e6a10", "tag": "4345b5d8-f0cd-4479-94b3-078ae0d1ae39"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:49.063951 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:49.064562 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:49.076753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.076951 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.077240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.077441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.077760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.077861 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.078581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.079034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.079453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.092064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] Creating event network-changed:4345b5d8-f0cd-4479-94b3-078ae0d1ae39 for instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 on hv-cinder-79053 Sep 07 13:15:49.095803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-f3a077e9-d9bd-49f3-9ee2-2bf09f801e4a req-b463a9c0-c174-494d-94a5-b0c9e58e4743 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043039 Sep 07 13:15:49.096491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 256/511] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:49.189330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:49.191834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:49.202268 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.203035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.204078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.204817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.205283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.205710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.247952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:49.263324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c7b78ffb-8022-478f-906b-47d21541ff10 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.203003 Sep 07 13:15:49.264112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 256/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:49 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:49.469128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:49.477506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-075d0b9d-0846-4f11-8e0c-2207d6f4b8fe tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.295979 Sep 07 13:15:49.478074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 257/513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:49 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:49.901159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:49.902373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:49.908252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.908736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.909192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:49.910002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:49.910484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:49.910912 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:50.041890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:50.049530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f19c8f35-c11b-4d56-a670-c94565622d5c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.152986 Sep 07 13:15:50.050760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 257/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:49 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:50.287668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:50.288278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:50.294780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:50.295240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:50.295671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:50.296347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:50.296795 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:50.297214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:50.427411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:50.435488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a9329f7f-f8a8-40f1-a291-8194892e358a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.152225 Sep 07 13:15:50.436052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 258/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:50 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:50.501336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:50.502040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:50.508996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:50.509574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:50.510009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:50.510723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:50.511319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:50.511748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:50.649827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:50.657845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-84017aa5-f8d4-440f-9883-86dd95963f34 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.160287 Sep 07 13:15:50.658524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 258/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:50 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:51.072812 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:51.073432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:51.079441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.079930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.080370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.081617 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.082129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.082596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.086606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:51.224831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:51.232657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8055e1ff-c9b4-416e-b74a-d14ba3b12c22 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.163677 Sep 07 13:15:51.233273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 259/517] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:51 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:51.459397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:51.459998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:51.466341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.466851 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.467284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.467960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.468410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.468828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.619292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:51.627946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d7147301-d3f5-43f0-a546-011c421af6f6 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.173158 Sep 07 13:15:51.628512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 259/518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:51 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:51.682502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:51.683166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:51.689604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.690085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.690556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.691246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:51.692372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:51.692803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:51.822281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:51.829889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5457cb61-1dbd-4418-9be6-68202751892e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.151349 Sep 07 13:15:51.830473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 260/519] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:51 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:52.256919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:52.257539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:52.263526 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.264017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.264456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.265143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.265601 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.266034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.392058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:52.400173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f3ff96be-42ca-4bcf-b77d-6d8e3e778f4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.147709 Sep 07 13:15:52.400733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 260/520] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:52 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:52.706086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:52.706734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:52.712763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.713244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.713682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.714367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.714850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.715275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.844634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:52.853360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0f301b18-8e6a-4162-b3a2-17157cbb75f7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.205029 Sep 07 13:15:52.853531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:52.853964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 261/521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:52 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:52.854111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:52.860687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.861173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.861611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.862300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:52.862781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:52.863204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:52.992939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:53.000775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0134468e-cc52-4e0e-8848-728e5cad5570 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.151025 Sep 07 13:15:53.001345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 261/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:52 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:53.424232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:53.424987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:53.431068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:53.431546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:53.431980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:53.432689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:53.433148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:53.433569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:53.559971 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:53.568460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-36da5897-d240-41b5-8b3e-12ef4dcd4e55 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.147840 Sep 07 13:15:53.569039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 262/523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:53 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:53.876286 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:53.876848 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:53.878738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:53.885131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:53.885619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:53.886054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:53.886777 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:53.887231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:53.887656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:54.023315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:54.032038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-42572235-b1a1-4db1-a326-e51487f6f2c5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.159318 Sep 07 13:15:54.032379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 262/524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:53 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:54.133553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:54.134171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:54.140080 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:54.140563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:54.141000 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:54.141683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:54.142138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:54.142590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:54.276202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:54.283974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8846def9-ba0b-4d8c-bbb7-6a14c2cd7db0 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1676 microversion: 2.1 time: 0.263988 Sep 07 13:15:54.284551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 263/525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:54 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:54.591820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:54.592733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:54.599779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:54.600470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:54.600911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:54.601613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:54.602072 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:54.602538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:54.740456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:54.749134 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a017f452-173c-41bb-84fb-b5b1b9d007ca tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.160792 Sep 07 13:15:54.762935 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 263/526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:54 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:55.056241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:55.056406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:55.063702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.064273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.064822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.065902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.066387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.067565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.205825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:55.214835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ae32ce01-cbe8-4805-b70b-3e7e957d2a6d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.162893 Sep 07 13:15:55.215433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 264/527] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:55 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:55.307992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:55.308633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:55.314927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.315405 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.315835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.317014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.317455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.317880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.447424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:55.455091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c82b834e-ff25-4a5e-b80b-677e7d2132a4 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1653 microversion: 2.1 time: 0.150887 Sep 07 13:15:55.455651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 264/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:55 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1653 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:55.477265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:55.479835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:55.480735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:55.486716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.487205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.487637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.510764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Going to try to start instance {{(pid=120738) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:15:55.550202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bd7cc2da-486f-4b38-b734-c907b5ccb222 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action" status: 202 len: 0 microversion: 2.1 time: 0.076737 Sep 07 13:15:55.550821 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 265/529] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:15:55 2022] POST /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:55.559924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:55.560543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:55.566592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.567756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.568444 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.569146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.569603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.570038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.699597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:55.707784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7cb783be-1850-4cea-81ec-cad7b521e8ea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1662 microversion: 2.1 time: 0.151775 Sep 07 13:15:55.708341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 265/530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:55 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:55.773713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:55.774401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:55.780748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.781228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.781665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.782344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.782817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.783238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.919245 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:55.927103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-91cae858-c74a-497f-aa3f-019cd1302a18 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.158353 Sep 07 13:15:55.927748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 266/531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:55 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:56.238050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:56.239388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:56.245774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:56.246266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:56.246907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:56.247646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:56.248102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:56.248528 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:56.381525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:56.390584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-33d0c409-33bb-414d-a810-d6e43c974891 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.156430 Sep 07 13:15:56.391148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 266/532] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:56 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:56.735528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:56.738551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:56.749147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:56.749756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:56.750450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:56.751367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:56.751759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:56.752267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:56.953271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:56.962863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5b254922-c533-4847-9d0c-fb50b0347aca tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1662 microversion: 2.1 time: 0.233452 Sep 07 13:15:56.963724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 267/533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:56 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:57.002376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:57.003331 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:57.010690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.011191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.011639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.012342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.012832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.013260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.119054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcd7087-bcdc-489b-8ba6-d784b65e6a10", "name": "network-vif-plugged", "status": "completed", "tag": "4345b5d8-f0cd-4479-94b3-078ae0d1ae39"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:57.128642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.130053 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.130704 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.144159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] Creating event network-vif-plugged:4345b5d8-f0cd-4479-94b3-078ae0d1ae39 for instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 on hv-cinder-79053 Sep 07 13:15:57.145785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:57.155276 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ef7a7d45-aed1-44bf-92d7-91f3026f81fb tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.207992 Sep 07 13:15:57.157375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 267/534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:56 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:57.161348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-997bd729-63d3-468d-b8d9-151adc524e70 req-5047916a-9b72-4e1a-9ba9-df4eddb57b51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045851 Sep 07 13:15:57.162487 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 268/535] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:57.414989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:57.415682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:57.422054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.422646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.423152 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.423838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.424295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.424719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.561860 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:57.570624 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e7f4f4ff-6929-4f50-baec-805f46d9d8b2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1737 microversion: 2.1 time: 0.160759 Sep 07 13:15:57.571269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 268/536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:57 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:57.986671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:57.987374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:57.994983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.995470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.995907 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.996599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.997056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.997484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.126882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:58.134578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-be40bc53-6094-42b7-ab11-e6b64929e84e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1662 microversion: 2.1 time: 0.152614 Sep 07 13:15:58.135146 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 269/537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:57 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:58.179786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:58.180411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:58.187251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.187739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.188174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.188863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.189315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.189744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.325122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:58.333077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-47251275-4d97-403d-ab33-f78dffe3f0de tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.157614 Sep 07 13:15:58.333535 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 269/538] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:58 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:58.594833 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:58.595471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:58.602139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.602748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.603280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.604057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.604567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.605000 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.736962 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:58.745136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd9a41db-aad0-4e15-92b6-25b5bd579711 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1717 microversion: 2.1 time: 0.154338 Sep 07 13:15:58.745698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 270/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:58 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:58.807171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:58.807698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:58.814280 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.814808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.815248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.815939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.816400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.817373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.902118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] HTTP exception thrown: Cannot 'detach_volume' instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 while it is in vm_state rescued Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Request method failure captured: Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments/f90acc07-f749-49e9-b374-98eb85ffe2f7 HTTP/1.1 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhaui2HLaVmzSyWD7xmJnx7cxSyM9KR_w_2EG9rAfoc8wO3BASPxSFNmhIsZFRLS-NhxX7k46xSthReO20TPNHaDj9pnzEhHNnH-EiLztw8qz4cYSBG18Zcx0DfjUtQRbBxt5MxP_yPAQx1e3IfkTI_Hf2jMO78c-nKorRLfv-ReB4 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:15:58.903660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb085890f54a44be94190bd67485bc2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: d5a9fcebd3164b59893658ad92dfcafb Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:15:58.905071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Cannot 'detach_volume' instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 while it is in vm_state rescued Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'server_id': '8263f5a1-67f2-48a7-8b3a-518e97db6455', 'id': 'f90acc07-f749-49e9-b374-98eb85ffe2f7'} Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:15:58.905766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 while it is in vm_state rescued Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 while it is in vm_state rescued Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:15:58.907056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Returning 409 to user: Cannot 'detach_volume' instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 while it is in vm_state rescued {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:15:58.908112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-02cc0344-914b-4fba-9657-f65f39e16267 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments/f90acc07-f749-49e9-b374-98eb85ffe2f7" status: 409 len: 152 microversion: 2.1 time: 0.101964 Sep 07 13:15:58.908112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 270/540] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:15:58 2022] DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments/f90acc07-f749-49e9-b374-98eb85ffe2f7 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 13:15:58.914257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:58.914855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:58.921032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.921521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.921952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.922673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.923125 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.923547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.989806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7054c4d0-0eed-4498-8e8d-b0b90f71622d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/action" status: 202 len: 0 microversion: 2.1 time: 0.079209 Sep 07 13:15:58.990722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 271/541] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:15:58 2022] POST /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:15:58.999379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:58.999997 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:59.008177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.008677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.009123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.009826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.010291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.010753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.143030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:59.152205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0af3d4c7-c8be-47a6-a73e-a089a93ddfec tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.156708 Sep 07 13:15:59.152784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 271/542] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:58 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:59.158216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:59.158951 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:59.165300 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.165933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.166515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.167251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.167775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.168199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.297741 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:59.306568 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-45295465-bc33-4684-97c1-a4ceaecdae18 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1662 microversion: 2.1 time: 0.152550 Sep 07 13:15:59.307128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 272/543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:59 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:15:59.355880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:59.356498 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:59.362468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.362954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.363392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.364571 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:59.365023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:59.365446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.369470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:59.491608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:59.499129 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c5888be1-97c0-4484-b7b1-48fff2058513 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1365 microversion: 2.1 time: 0.147091 Sep 07 13:15:59.499692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 272/544] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:59 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:00.175315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:00.175936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:00.182799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.183293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.183736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.184438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.184898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.185328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.314695 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:00.324131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-52ddc3f3-81b6-464b-b333-e4b751744516 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.152707 Sep 07 13:16:00.324719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 273/545] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:00 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:00.330203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:00.330863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:00.339856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.340362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.340804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.341511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.341971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.342400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.484717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:00.493173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5627ebea-e0b8-48f1-b1ae-a235ec006cea tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1662 microversion: 2.1 time: 0.166782 Sep 07 13:16:00.493755 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 273/546] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:00 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:00.522462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:00.523006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:00.529066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.529559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.529999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.530712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.531169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.531594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.550810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:00.664232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:00.671914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-08d1f6d5-f01b-48d4-b3fe-8ad9a48ef7fa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1555 microversion: 2.1 time: 0.153682 Sep 07 13:16:00.672496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 274/547] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:00 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:00.695498 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:00.695999 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:00.701948 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.702458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.702906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.703593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.704056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.704482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.788070 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a7c54b11-9eed-4b86-aa2f-37a6fddbabcf tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097211 Sep 07 13:16:00.788688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 274/548] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:16:00 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:01.349453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:01.350090 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:01.357165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.357663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.358109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.358846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.359306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.359737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.516245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:01.516864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:01.523599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.524092 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.524531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.525230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.525689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.526120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.635020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:01.643271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-562d22e6-3a53-4e5c-bc11-89d09e09fb16 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.298323 Sep 07 13:16:01.643852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 275/549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:01 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:01.662599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:01.670658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-eb5540b8-de49-4d6f-8153-f535210ac375 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1666 microversion: 2.1 time: 0.158718 Sep 07 13:16:01.671223 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 275/550] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:01 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:01.853472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcd7087-bcdc-489b-8ba6-d784b65e6a10", "tag": "4345b5d8-f0cd-4479-94b3-078ae0d1ae39"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:01.862853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.863334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.863997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.876607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] Creating event network-changed:4345b5d8-f0cd-4479-94b3-078ae0d1ae39 for instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 on hv-cinder-79053 Sep 07 13:16:01.884145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-ef7a95d1-576f-4211-84aa-4ea73c41957a req-83709602-76bb-42a9-a64b-dc07f44d1669 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032714 Sep 07 13:16:01.884145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 276/551] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:02.667346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:02.667953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:02.674366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:02.674902 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:02.675340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:02.676033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:02.676589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:02.677099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:02.898715 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:02.907362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-88b9c49e-a1aa-4ea3-9103-476de54f41e7 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.243754 Sep 07 13:16:02.907947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 276/552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:02 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:03.932130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:03.932822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:03.938914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:03.939389 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:03.939824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:03.940496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:03.940975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:03.941396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:04.074503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:04.082745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9192e94-24a5-48b6-a7f4-89c6690e5d4b tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.155694 Sep 07 13:16:04.083573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 277/553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:03 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:05.106126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:05.106926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:05.114209 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:05.115295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:05.115731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:05.116423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:05.116874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:05.117294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:05.259265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:16:05.259519 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Wed Sep 7 13:16:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 (ip 10.222.0.65) !!! Sep 07 13:16:05.263934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:05.279257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bd326a09-db45-476d-b44b-de0da8ee5651 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.177194 Sep 07 13:16:05.279832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 277/554] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:05 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:06.304479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:06.305310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:06.315328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:06.316157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:06.316693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:06.318153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:06.320912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:06.320912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:06.469085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:06.477840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f6e1279f-b6c0-4cac-9f7f-5c95bb6ae788 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1725 microversion: 2.1 time: 0.178738 Sep 07 13:16:06.478436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 278/555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:06 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:07.503741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:07.505966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:07.513437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:07.513927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:07.514614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:07.515313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:07.515771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:07.516189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:07.669481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:07.696222 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-51ea7553-ba3d-48a0-b2f7-53606314c171 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1731 microversion: 2.1 time: 0.196213 Sep 07 13:16:07.697215 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 278/556] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:07 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:07.720620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:07.721369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:07.731960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:07.732736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:07.733379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:07.734314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:07.734780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:07.735220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:07.838947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e81f3df4-495d-4e72-8e2c-3743b7a537ce tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122162 Sep 07 13:16:07.839567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 279/557] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:16:07 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:08.855967 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:08.872850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.873635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.875742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.897818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] Creating event network-changed:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:16:08.914978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-2ae448f8-bc4b-48a1-9674-609e706284bf req-4fd9dd11-6ebb-4627-a6d4-4b87dce3c16e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063596 Sep 07 13:16:08.917874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 279/558] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:10.941555 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:10.952528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:10.953013 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:10.953456 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:10.965282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] Creating event network-changed:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:16:10.970799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5e3f8606-f50b-4d98-82ea-f9b6f4ed1462 req-9b4ef5cc-13f3-4ba9-9f95-f20cf8e94d51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Sep 07 13:16:10.971748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 280/559] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:16.087647 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7a6a6179-838a-4300-984d-fba6bedb210c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Action: 'create', calling method: .version_select at 0x7f7f2b6d8ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2047053971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoXABd9Ulumzd6Jp+TPsbaMq+23xeahM2RPRncY0esyix35VKKqv5WSNwOZg23jx9TAuDlsFOuPOAYi/iPbiR4C8FpgABx3Qs7fXaP7a6brrpxBmU1Tq5rKYe8n5jL4qA=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:16.092992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:16.105734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-7a6a6179-838a-4300-984d-fba6bedb210c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for project e272b3e5ef9244098642eef1a8c4be51. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:16.109558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-7a6a6179-838a-4300-984d-fba6bedb210c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for user bf4f0ec8413644aea92cd53c1e54b5d7 and project e272b3e5ef9244098642eef1a8c4be51. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:16.134023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7a6a6179-838a-4300-984d-fba6bedb210c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.219117 Sep 07 13:16:16.134689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 280/560] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:16:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:39.838179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:39.839071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=28 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:39.843676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-49544765", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047053971", "security_groups": [{"name": "tempest-secgroup-smoke-483916809"}], "block_device_mapping_v2": [{"uuid": "d50dbddd-8317-4bd3-b102-678078321c4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74553432-837c-413c-8ed6-0393cb35ede1"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:39.962316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] validate_networks() for [('74553432-837c-413c-8ed6-0393cb35ede1', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:40.431195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:40.431700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:40.432217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:40.432618 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:40.433021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:40.441639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.442108 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.442574 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.443289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.443740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.444155 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.460940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:40.465705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for user bf4f0ec8413644aea92cd53c1e54b5d7 and project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:40.521491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:40.523748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d50dbddd-8317-4bd3-b102-678078321c4c',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:40.655784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-07922a5b-0e69-4e67-8cef-a1af1d927533 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820738 Sep 07 13:16:40.656440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 281/561] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:40.664909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=40 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:40.666641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:40.667180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:40.671581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-69807431-8547-44dd-929e-8cc4738f5b7b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.674040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-69807431-8547-44dd-929e-8cc4738f5b7b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.732889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-69807431-8547-44dd-929e-8cc4738f5b7b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:40.739643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-69807431-8547-44dd-929e-8cc4738f5b7b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1093 microversion: 2.1 time: 0.075894 Sep 07 13:16:40.740207 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 281/562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:41.763143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:41.763758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:41.771750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:41.772352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:41.772892 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:41.773866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:41.774453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:41.774983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:41.840658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:41.848449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f34727d8-e0b7-4592-92cd-94c6a58146ce tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1191 microversion: 2.1 time: 0.089683 Sep 07 13:16:41.849022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 282/563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:41 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:42.872211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:42.872924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.879569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.880078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.880505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.881511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.881978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.882440 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.955676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:42.963457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-598fd6ac-bbb7-411d-9678-3e3bb2ce4e36 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1209 microversion: 2.1 time: 0.095266 Sep 07 13:16:42.964026 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 282/564] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:42 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:43.987463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:43.988140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:43.995127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.995741 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.996882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.997709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:44.002326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:44.002818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:44.060705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a", "tag": "9a5217aa-b7cb-4589-9ba3-784d73d8cf16"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:44.071282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:44.072348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:44.073025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:44.085358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] Creating event network-changed:9a5217aa-b7cb-4589-9ba3-784d73d8cf16 for instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a on hv-cinder-79053 Sep 07 13:16:44.090585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-e4618372-3358-42eb-ac9c-2c8c1e579214 req-867c2314-9147-4dbe-8dd6-6bb65f1c56ab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104391 Sep 07 13:16:44.091182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 283/565] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:44.141799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:44.149376 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a1ac8304-4b2f-4f23-9d7e-a883199ed7ed tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.165850 Sep 07 13:16:44.149946 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 283/566] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:43 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:45.173870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:45.175121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:45.182090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:45.183272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:45.184414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:45.185120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:45.185572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:45.185993 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:45.382610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:45.390266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-739f4249-99e0-454f-8702-217f28123d69 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.221019 Sep 07 13:16:45.391485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 284/567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:45 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:46.413058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:46.413691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:46.421717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.422230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.424237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.425234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:46.425703 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:46.426130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:46.555599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.563850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bc233510-a04e-43bc-b9d6-5b5bba4a63aa tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.154658 Sep 07 13:16:46.564411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 284/568] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:46 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:47.587520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:47.588043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:47.599759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.600250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.600692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.601386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.601846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.602275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.736423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:47.744047 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-974ec027-4e46-4874-a8b9-0363ac489912 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.160461 Sep 07 13:16:47.744607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 285/569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:47 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:48.765757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:48.766376 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:48.772542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.773033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.773479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.774195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:48.774692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:48.775128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.906719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.914280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d31a4424-bc22-4170-96f2-391d68de7b90 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.152730 Sep 07 13:16:48.914884 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 285/570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:48 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:49.938043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:49.938696 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:49.945075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.945549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.945979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.946693 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.947398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.947816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.080457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:50.088026 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-549d5039-910d-422a-8cd3-c32cfff36368 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.154342 Sep 07 13:16:50.088576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 286/571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:49 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:51.110651 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:51.111270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:51.113600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:51.114260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:51.120699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.121180 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.121612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.122297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.123479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.123967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.255259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:51.262791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1fc617b8-2922-495e-a6eb-dc809eb78eda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.156755 Sep 07 13:16:51.263356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 286/572] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:51 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:52.285789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:52.286400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:52.288442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:52.294079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:52.294596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:52.295561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:52.296251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:52.296704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:52.297130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:52.647927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:52.656147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6bf9f988-5de8-4834-95ca-3954aef38655 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.374133 Sep 07 13:16:52.656707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 287/573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:52 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:53.678461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:53.679113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:53.685728 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.686226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.686692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.687384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.687841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.688350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.824403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.832704 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-56c7718d-ede2-42d2-8d83-ea8c323bb42a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.158126 Sep 07 13:16:53.833279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 287/574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:53 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:54.855397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.855999 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.862989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.863477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.863922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.864615 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.865080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.865508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.994543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:55.002719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ff974e2e-0ea9-47e7-8bf2-36a814f4090e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.151119 Sep 07 13:16:55.003291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 288/575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:55.599089 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a", "name": "network-vif-plugged", "status": "completed", "tag": "9a5217aa-b7cb-4589-9ba3-784d73d8cf16"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:55.609186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.609669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.610100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:55.622189 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] Creating event network-vif-plugged:9a5217aa-b7cb-4589-9ba3-784d73d8cf16 for instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a on hv-cinder-79053 Sep 07 13:16:55.627979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-58e86404-7adc-4a53-b928-058d14a3fe7e req-837e740a-4156-4b32-aca3-7133ffe473a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094097 Sep 07 13:16:55.628579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 288/576] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:56.025543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:56.026160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:56.033568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.034056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.034529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.035229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.035685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.036195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.199900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.208838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e17444f5-c201-4f58-8743-d5b7bf34d7f3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.187473 Sep 07 13:16:56.209406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 289/577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:56 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:57.234122 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:57.234872 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:57.241579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.242070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.242539 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.243234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:57.243692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:57.244126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.374614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.382286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a2b2557d-b978-4c85-bff5-a2813dc9d801 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1264 microversion: 2.1 time: 0.152976 Sep 07 13:16:57.383128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 289/578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:57 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:58.405119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:58.405734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:58.412153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.412638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.413080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.413764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.414217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.414663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.548530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:58.556250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9702f8c0-9e86-451e-840c-32acfc9b7061 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1451 microversion: 2.1 time: 0.155027 Sep 07 13:16:58.556816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 290/579] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:58 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:58.579601 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:58.580218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:58.586645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.587132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.587565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.588248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:58.588700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:58.589124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:58.734035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:58.741847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ae85aca1-5989-445b-aca9-95169bf7e49d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1451 microversion: 2.1 time: 0.166375 Sep 07 13:16:58.742438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 290/580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:58 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:00.659680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a", "tag": "9a5217aa-b7cb-4589-9ba3-784d73d8cf16"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:00.669032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:00.669564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:00.670001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:00.681387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] Creating event network-changed:9a5217aa-b7cb-4589-9ba3-784d73d8cf16 for instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a on hv-cinder-79053 Sep 07 13:17:00.686970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-1bcb8773-fc85-46e6-8c8e-9631d142d1a5 req-cd474942-296c-439b-90e3-b739cdc5437e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085380 Sep 07 13:17:00.687592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 291/581] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:02.104239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.106596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.115190 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.115666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.116110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.116818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.117278 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.117712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.148473 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eda16d93-5a21-4964-b96c-ab8c40c85980 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051248 Sep 07 13:17:02.149034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 291/582] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:17:02.216325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.216906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.223117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.223596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.224028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.224704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.225185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.225632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.251585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:17:02.330954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a069bb0a-e39b-45c2-b6f2-6d0b938f78db tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 204 len: 0 microversion: 2.1 time: 0.118787 Sep 07 13:17:02.331458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 292/583] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:17:02 2022] DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:17:02.339907 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:02.340727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:02.347110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.347596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.348045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.348763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:02.349221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:02.349648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:02.487328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:02.495176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-19c786c3-8d77-44af-a258-635c6e336162 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1672 microversion: 2.1 time: 0.159345 Sep 07 13:17:02.495743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 292/584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:02 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:03.519701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:03.520408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:03.526801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.527293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.527735 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.528430 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.528972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.529470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.659974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:03.667620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d56751d9-b014-4c51-a8d1-415ca1df1a38 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1672 microversion: 2.1 time: 0.152332 Sep 07 13:17:03.668177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 293/585] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:03 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:04.691205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:04.691871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:04.698916 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.699407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.699824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.700521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:04.700970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:04.701396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:04.842526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:04.850309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bc8702f1-216a-45aa-b8a6-413c3f696929 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1672 microversion: 2.1 time: 0.163056 Sep 07 13:17:04.850912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 293/586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:04 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:05.111791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e96a0f-85ee-4d00-b876-e7bf7d4547db", "name": "network-vif-deleted", "tag": "7d0305ef-b6d3-41de-96c2-c924a8086341"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:05.121345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.121828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.122268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.133422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] Creating event network-vif-deleted:7d0305ef-b6d3-41de-96c2-c924a8086341 for instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db on hv-cinder-79053 Sep 07 13:17:05.151000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-988d846f-6b1f-4d41-a01a-3964f3ab59c1 req-557b33f2-51d2-4079-9561-66d618bc477e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042742 Sep 07 13:17:05.152836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 294/587] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:05.873518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:05.874251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:05.880819 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.881402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.881848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.882577 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.883036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.883484 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.916108 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:05.916586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:05.917021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:05.917463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lazy-loading 'fault' on Instance uuid 04e96a0f-85ee-4d00-b876-e7bf7d4547db {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:05.962282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:05.970863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b6a009b5-0441-4d36-9171-a148b4236870 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 200 len: 1327 microversion: 2.1 time: 0.101499 Sep 07 13:17:05.971768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 294/588] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:05 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:06.994934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:06.995644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:07.002103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.002622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.003056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.003742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:07.004214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:07.004634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:07.017924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db HTTP/1.1 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:17:07.019578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:17:07.021262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '04e96a0f-85ee-4d00-b876-e7bf7d4547db'} Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:07.022226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:17:07.023920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:07.025330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:07.025330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bd90378c-7f6f-4f07-b7e4-ae268dd8ebb2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 404 len: 111 microversion: 2.1 time: 0.030842 Sep 07 13:17:07.025330 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 295/589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:06 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:07.029736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b6ee8e00-f010-4c0b-829d-0019b993a81a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '.version_select at 0x7f7f2b637790>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:07.049926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b6ee8e00-f010-4c0b-829d-0019b993a81a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923755522" status: 202 len: 0 microversion: 2.1 time: 0.023930 Sep 07 13:17:07.050521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 295/590] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Sep 7 13:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923755522 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:17:07.690889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6a16f914-f110-48a3-ab8e-ea409937243a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: .version_select at 0x7f7f2b6d8040>, body: {"keypair": {"name": "tempest-keypair-1977234134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3804MAcBHWRZnUZQY5CyruF1TQchYr0cP5eid5xCGXyZ1yVccjhVg0YRlHjLGyPjYFPr7MIl5A+2cXk3jaB7eOZzOVOGhD0CsixKleWLTgNHl/Ven3lgcWJGgdukWJgA=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:07.706886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-6a16f914-f110-48a3-ab8e-ea409937243a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for project c3738db936ec4845ac4ac33f78816fb1. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:07.710812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-6a16f914-f110-48a3-ab8e-ea409937243a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for user 458eb2f4b67541a69e30b238c7d2a78b and project c3738db936ec4845ac4ac33f78816fb1. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:07.732416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6a16f914-f110-48a3-ab8e-ea409937243a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046121 Sep 07 13:17:07.733020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 296/591] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:17:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:08.990909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1255584845", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45cf53b7-1bc3-49c2-b27f-b303adbc949b"}], "security_groups": [{"name": "tempest-securitygroup--2010786430"}], "key_name": "tempest-keypair-1977234134", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:09.102078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] validate_networks() for [('45cf53b7-1bc3-49c2-b27f-b303adbc949b', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:17:09.475848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:17:09.476273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:17:09.476777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:17:09.477220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:17:09.477634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:17:09.487263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.487746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.488182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.488904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.489358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.489781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.506155 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for project c3738db936ec4845ac4ac33f78816fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:09.510060 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Getting quotas for user 458eb2f4b67541a69e30b238c7d2a78b and project c3738db936ec4845ac4ac33f78816fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:09.521482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:17:09.523769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:17:09.570786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2d591f08-46d1-4612-9b4a-628251572d81 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584656 Sep 07 13:17:09.571434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 296/592] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:17:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:17:09.583762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9f63f45e-f9f7-4350-85c2-4068773e6fb7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.584971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9f63f45e-f9f7-4350-85c2-4068773e6fb7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.640682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9f63f45e-f9f7-4350-85c2-4068773e6fb7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:09.647776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9f63f45e-f9f7-4350-85c2-4068773e6fb7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1238 microversion: 2.1 time: 0.068277 Sep 07 13:17:09.648351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 297/593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:09.864027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.864530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.868035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:09.874685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.875323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.875769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.876638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.877195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.877805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.881570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=81 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:09.884818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:09.885719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:09.892932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.893357 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.893809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.894564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:09.895328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:09.895977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:09.929870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-86e84a61-c202-4b75-b5bd-54c6773365a4 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/ips" status: 200 len: 149 microversion: 2.1 time: 0.050726 Sep 07 13:17:09.931337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 298/594] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:17:09 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:09.970700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'services' on Instance uuid 8263f5a1-67f2-48a7-8b3a-518e97db6455 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:10.054153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6df2c461-e5aa-4945-bd94-5ad47f164fd0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments/f90acc07-f749-49e9-b374-98eb85ffe2f7" status: 202 len: 0 microversion: 2.1 time: 0.193398 Sep 07 13:17:10.055313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 297/595] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:17:09 2022] DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments/f90acc07-f749-49e9-b374-98eb85ffe2f7 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:17:10.065390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:10.068064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:10.076308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.077926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.078668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.080045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.080739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.081706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.116513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-496adeea-9e91-40aa-8a85-7d16cad02eda tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056413 Sep 07 13:17:10.121684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 299/596] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:10 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:10.671020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:10.671719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:10.677803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.678288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.678757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.679443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:10.679894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:10.680317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:10.759287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:10.771847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cbab79a0-5f8d-4ecc-bf9f-51322cb37a26 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1290 microversion: 2.1 time: 0.103732 Sep 07 13:17:10.771847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 298/597] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:10 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:11.130977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:11.133801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.137626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.144938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.145453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.146187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.147226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.147695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.148136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.153446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:11.185317 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2b554c7d-e122-419d-b1b5-bd858831bec0 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059348 Sep 07 13:17:11.190811 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 300/598] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:11 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:11.315330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762d145f-e385-42ec-951b-bddcb075ce4f"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:11.317748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.324416 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.324901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.325341 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.326032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.326532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.327036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.797314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:11.797931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:11.804558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.805043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.805481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.806166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:11.806652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:11.807081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:11.871192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:11.878778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ee853851-af25-478d-b353-34a9375b62d1 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1290 microversion: 2.1 time: 0.085328 Sep 07 13:17:11.879354 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 301/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:11 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:12.182692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4a060696-1ab8-4772-a182-a87696363d23 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871674 Sep 07 13:17:12.183311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 299/600] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:17:11 2022] POST /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:12.199429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.202137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.211098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.212368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.212885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.214604 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.215238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.216448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.256882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-732215be-9e19-4d70-a88e-956b1ba73387 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062686 Sep 07 13:17:12.257655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 302/601] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:17:12.343835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.344552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.351031 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.351515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.351954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.352641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.353096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.353521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.380882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:17:12.454851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e123ec8f-1e36-4ccf-93c9-99172240c7f5 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 204 len: 0 microversion: 2.1 time: 0.115088 Sep 07 13:17:12.455425 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 300/602] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:17:12 2022] DELETE /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:17:12.463396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.464015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.471099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.471581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.472012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.472698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.473177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.473597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.688684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.696287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-360552c6-d187-4969-88e6-bd58fe1cc208 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1691 microversion: 2.1 time: 0.236672 Sep 07 13:17:12.697217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 303/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:12.903207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:12.903985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:12.911481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.911973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.912413 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.913114 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:12.913577 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:12.914007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:12.982335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:12.990317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-101785b1-6fb0-4c0e-b1ec-ea4fb5dfd989 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1296 microversion: 2.1 time: 0.091816 Sep 07 13:17:12.990948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 301/604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:12 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:13.720759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:13.721376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:13.728223 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.728772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.729306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.730069 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:13.730602 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:13.731190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:13.861460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:13.869146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-30d0c1ef-1439-4374-84c8-9628d24b8944 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1691 microversion: 2.1 time: 0.152915 Sep 07 13:17:13.869707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 304/605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:13 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:14.015261 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:14.015915 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:14.022298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.022817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.023253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.023939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.024391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.025110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.152234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:14.160439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eb088376-fa44-4638-9c5d-ac97a4343109 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.149742 Sep 07 13:17:14.161005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 302/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:14 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:14.892364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:14.893014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:14.899327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.899808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.900242 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:14.900923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:14.901375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:14.901797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.034491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.042190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-88d62f25-aab5-450d-8dc8-e248c5161f51 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1691 microversion: 2.1 time: 0.153774 Sep 07 13:17:15.042844 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 305/607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:14 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:15.182851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:15.183386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:15.190052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.190575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.191024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.191735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:15.192196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:15.192627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:15.319095 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:15.326841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d5bcd900-27de-439a-b9e6-c1f60dd7ddbb tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.148000 Sep 07 13:17:15.327548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 303/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:15 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:16.065974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:16.066648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:16.072978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.073467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.074168 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.074891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.075352 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.075782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.207203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.214957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-032d8e7f-e00a-414d-a811-a939002bc0ba tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1691 microversion: 2.1 time: 0.153015 Sep 07 13:17:16.215524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 306/609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:16 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:16.350602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:16.351143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:16.357516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.357991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.358481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.359213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:16.359668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:16.360093 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:16.496136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:16.503956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1611ea84-0a6b-47cb-a7f1-75a54d167180 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.157805 Sep 07 13:17:16.504531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 304/610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:16 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:17.239808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.240467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.247111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.247591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.248022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.248702 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.249929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.250246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.380632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.388324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1d1d4f44-ac72-41d4-b35f-e843d120683a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1691 microversion: 2.1 time: 0.152538 Sep 07 13:17:17.388891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 307/611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:17.526542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:17.527877 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:17.535214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.535888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.536659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.537856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:17.538316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:17.538802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:17.674965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:17.682993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9878bb37-213f-4905-89e2-110e9b5faaa9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.160064 Sep 07 13:17:17.683604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 305/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:17 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:18.312709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e569be-2078-4315-8e69-36bdcd41f72b", "tag": "45ce7ccd-3b28-43db-b224-41a2885c97fe"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:18.325280 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.326059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.326532 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.350837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] Creating event network-changed:45ce7ccd-3b28-43db-b224-41a2885c97fe for instance 70e569be-2078-4315-8e69-36bdcd41f72b on hv-cinder-79053 Sep 07 13:17:18.359959 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-86bdbff9-46f3-44a2-a18f-b4741f1fc747 req-15a07e13-09d8-4c07-a7b3-e475a8b5f238 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054578 Sep 07 13:17:18.361602 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 308/613] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:18.414460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.415347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.423079 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.423784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.424402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.425103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.425554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.426058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.510271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:18.519486 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3f263428-7518-4a11-a764-f306549a6639 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1624 microversion: 2.1 time: 0.108969 Sep 07 13:17:18.520342 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 306/614] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1624 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:18.704900 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8263f5a1-67f2-48a7-8b3a-518e97db6455", "name": "network-vif-deleted", "tag": "82623be9-5737-4479-87c3-b50600c7de3d"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:18.715121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.715863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.716493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.717597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:18.719803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:18.730348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] Creating event network-vif-deleted:82623be9-5737-4479-87c3-b50600c7de3d for instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 on hv-cinder-79053 Sep 07 13:17:18.740022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-4508871f-ae48-4e49-906a-542026976904 req-2b3b6251-048b-461c-8000-f9edf0643d72 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037970 Sep 07 13:17:18.740166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.740639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 309/615] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:18.741679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.742198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.743781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:18.744249 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:18.744674 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:18.915929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:18.926471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-db1f7a89-eb17-4e68-af06-929ad3e73227 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.224480 Sep 07 13:17:18.929651 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 307/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:18 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:19.543838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:19.544539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:19.551206 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.551767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.552204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.552902 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.553355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.553781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.585794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.586281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.586752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.587201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'fault' on Instance uuid 8263f5a1-67f2-48a7-8b3a-518e97db6455 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:19.630768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:19.638591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cf67b346-83f4-43a4-a7eb-29be5f4138a9 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1336 microversion: 2.1 time: 0.099401 Sep 07 13:17:19.639246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 310/617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:19 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:19.951929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:19.953157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:19.955202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:19.955863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:19.962870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.963364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.963804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:19.964502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:19.964963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:19.965391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.093669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.101449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f4b788b3-45c7-488f-8e1a-adf691cdc86a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.153589 Sep 07 13:17:20.102027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 308/618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:19 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:20.665055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:20.665698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:20.670294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:20.676780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.677264 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.677698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.678380 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.678956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.679572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.731495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:20.731981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:20.732419 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:20.732869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'fault' on Instance uuid 8263f5a1-67f2-48a7-8b3a-518e97db6455 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:20.782976 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:20.790807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-02042e0f-75f7-4730-b05d-de7a6a83d9bb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 200 len: 1336 microversion: 2.1 time: 0.132617 Sep 07 13:17:20.791377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 311/619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:20 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:21.130723 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.131869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.139429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.139919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.141165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.141876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.142328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.142774 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.311744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:21.319996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6c0f850c-b9e3-4611-98f5-7d177841f773 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.198241 Sep 07 13:17:21.320570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 309/620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:21.814041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.814752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 8263f5a1-67f2-48a7-8b3a-518e97db6455] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:21.821232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.821722 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.822161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.822885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:21.823343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:21.823767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:21.837288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] HTTP exception thrown: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Request method failure captured: Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 HTTP/1.1 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhaui2HLaVmzSyWD7xmJnx7cxSyM9KR_w_2EG9rAfoc8wO3BASPxSFNmhIsZFRLS-NhxX7k46xSthReO20TPNHaDj9pnzEhHNnH-EiLztw8qz4cYSBG18Zcx0DfjUtQRbBxt5MxP_yPAQx1e3IfkTI_Hf2jMO78c-nKorRLfv-ReB4 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:17:21.838955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb085890f54a44be94190bd67485bc2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: d5a9fcebd3164b59893658ad92dfcafb Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. Sep 07 13:17:21.840493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '8263f5a1-67f2-48a7-8b3a-518e97db6455'} Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:21.841381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. Sep 07 13:17:21.842872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:21.844454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Returning 404 to user: Instance 8263f5a1-67f2-48a7-8b3a-518e97db6455 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:21.844454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-97eeec50-4561-45a0-957d-778b9ec70324 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455" status: 404 len: 111 microversion: 2.1 time: 0.031186 Sep 07 13:17:21.844454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 312/621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:21 2022] GET /compute/v2.1/servers/8263f5a1-67f2-48a7-8b3a-518e97db6455 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:21.849210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-17544b01-fd0e-43f0-89fe-cf9eeb11cc68 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '.version_select at 0x7f7f2b63b0d0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:21.867830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-17544b01-fd0e-43f0-89fe-cf9eeb11cc68 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092454450" status: 202 len: 0 microversion: 2.1 time: 0.022438 Sep 07 13:17:21.868390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 310/622] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Sep 7 13:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092454450 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:17:22.345503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:22.346120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:22.352056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.352550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.353140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.353836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:22.354285 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:22.354739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:22.579734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:22.587349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d3574065-553b-4ebb-a796-bff0aa142b14 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.246947 Sep 07 13:17:22.587910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 313/623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:22 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:23.612652 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:23.613462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:23.619336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.619814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.620247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.620930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.621398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.621826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.626272 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:23.637980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e569be-2078-4315-8e69-36bdcd41f72b", "name": "network-vif-plugged", "status": "completed", "tag": "45ce7ccd-3b28-43db-b224-41a2885c97fe"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:23.651584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:23.652077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:23.652726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:23.664581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] Creating event network-vif-plugged:45ce7ccd-3b28-43db-b224-41a2885c97fe for instance 70e569be-2078-4315-8e69-36bdcd41f72b on hv-cinder-79053 Sep 07 13:17:23.681049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-7478f3ab-cd34-469a-a681-3a94914f4829 req-a88d4893-74d9-4c86-b8bc-a22a88d63a59 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047330 Sep 07 13:17:23.683015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 314/624] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:23.770787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:23.779378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0a2f592c-da85-427c-9427-48c860ef0204 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.171785 Sep 07 13:17:23.779957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 311/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:23 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:24.803832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.804458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.810634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.811122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.811566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.812259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.812719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.813145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.852619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.853256 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.859837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.860325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.860765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.862290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.862864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.863299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.888540 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:17:24.958109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:24.966551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-05cb7e96-91df-4806-897e-7554bb73e740 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.168055 Sep 07 13:17:24.967131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 315/626] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:24.977672 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7988d940-9e4f-4e68-a6e9-51af064b90c8 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 204 len: 0 microversion: 2.1 time: 0.118611 Sep 07 13:17:24.977672 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 312/627] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:17:24 2022] DELETE /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:17:24.977672 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:24.978191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:24.983818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.984304 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.984739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:24.985426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:24.985880 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:24.986895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.087138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762d145f-e385-42ec-951b-bddcb075ce4f"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:25.089425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.095398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.096687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.097664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.098122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.098639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.099080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.133355 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:25.143466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-09794434-09d8-43d3-a801-7baca18edbee tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1507 microversion: 2.1 time: 0.170240 Sep 07 13:17:25.144314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 313/628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:24 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:25.182746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: POST /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments HTTP/1.1 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 74 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:17:25.184716 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {"volumeAttachment": {"volumeId": "762d145f-e385-42ec-951b-bddcb075ce4f"}} Sep 07 13:17:25.186356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'server_id': '6dcd7087-bcdc-489b-8ba6-d784b65e6a10', 'body': {'volumeAttachment': {'volumeId': '762d145f-e385-42ec-951b-bddcb075ce4f'}}} Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:25.187295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:25.188703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 400 to user: Invalid volume: volume 762d145f-e385-42ec-951b-bddcb075ce4f is already attached to instances: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c78339b8-3eb1-46de-80b6-8ff2d778c63a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103000 Sep 07 13:17:25.190299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 316/629] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:17:25 2022] POST /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:17:25.258170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.258791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.265213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.265797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.266334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.267143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.268362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.268840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.356518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'services' on Instance uuid 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:25.426716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-27867421-5047-41ac-a404-dc89cd5ee7a5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments/762d145f-e385-42ec-951b-bddcb075ce4f" status: 202 len: 0 microversion: 2.1 time: 0.172406 Sep 07 13:17:25.427391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 314/630] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:17:25 2022] DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments/762d145f-e385-42ec-951b-bddcb075ce4f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:17:25.435635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.438353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.445154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.445648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.446091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.446822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.447284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:25.447718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:25.477840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-eed2e01b-e2d4-4601-b2e3-6b395215a48b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Sep 07 13:17:25.478392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 317/631] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:25.992566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:25.993263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:25.999373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:25.999857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.000298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.000985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.001441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.001864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.143719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.151433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-05d9d44a-5920-44dc-848b-4e76272e2a62 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.163509 Sep 07 13:17:26.152006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 315/632] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:25 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:26.167106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:26.167759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:26.174768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.175258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.175698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.176392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.176851 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.177279 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.306619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:26.308909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:26.316574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0aae1e4f-a13f-4209-ae5c-e2bfd46a1a06 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1507 microversion: 2.1 time: 0.153257 Sep 07 13:17:26.317140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 318/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:26 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:26.490198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:26.492591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:26.498696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.499188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.499634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.500325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:26.500784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:26.501215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:26.531140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8e1769dd-8bcf-4455-8360-292f6ecedbfa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Sep 07 13:17:26.531619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 316/634] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:26 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:27.174175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.174772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.181814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.182295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.182774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.183473 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.183930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.184356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.312450 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.320162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-04cf06b4-e2a7-4115-b2ac-c637b3381daa tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1364 microversion: 2.1 time: 0.149983 Sep 07 13:17:27.320718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 319/635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:27.339485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.340169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.346683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.347165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.348221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.349094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.349551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.349980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.512145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:27.520937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5ae6980b-530a-4c73-bd6f-d37a00323c21 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1507 microversion: 2.1 time: 0.185252 Sep 07 13:17:27.521503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 317/636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:27.543576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:27.545828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:27.552146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.552628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.553060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.553737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:27.554189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:27.554653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:27.583832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-964236a0-1c81-45ec-916b-74f96cc8fca9 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Sep 07 13:17:27.584370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 320/637] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:27 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:28.342009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.342658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.348893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.349379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.349820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.350538 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.351003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.351442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.493644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.511945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7885b51e-0370-4ba9-973e-cd4a60b3c506 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1549 microversion: 2.1 time: 0.173723 Sep 07 13:17:28.512533 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 318/638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:28.534244 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.534834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.541856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.542341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.542811 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.543501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.543954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.544376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.545168 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.545867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.553924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.554532 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.555036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.555968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.556739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.557172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.658098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-34ceaa84-c45d-4727-a66a-063adf1dc743 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127702 Sep 07 13:17:28.658939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 321/639] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:28.666481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:28.669387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:28.675650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.676662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.677283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.678181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.678705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.679393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.713945 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ab1bfee1-9282-488f-8c89-04d2dc4ba468 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053448 Sep 07 13:17:28.715375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 322/640] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:28.772668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:28.781718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d2e584b3-3ef7-4da8-8d77-5d747a6257f2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1507 microversion: 2.1 time: 0.241106 Sep 07 13:17:28.782306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 319/641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:28 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:28.917989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87baeec7-935c-4c71-87db-693080de3051", "name": "network-vif-deleted", "tag": "7c9852da-200d-449a-93d7-10765318ac7b"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:28.938105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:28.938627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:28.939064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:28.954216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] Creating event network-vif-deleted:7c9852da-200d-449a-93d7-10765318ac7b for instance 87baeec7-935c-4c71-87db-693080de3051 on hv-cinder-79053 Sep 07 13:17:28.963156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-531c91c9-73c4-476d-9ffe-464f39be482d req-59e02b2d-51d3-4d61-a1d5-92dbbf400a03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049031 Sep 07 13:17:28.964595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 323/642] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:29.727599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.729771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.735957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.736444 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.736882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.737571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.738282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.738775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.768391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a8b6a73f-4d36-4ca5-908b-6da0838c1617 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045446 Sep 07 13:17:29.768858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 320/643] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:17:29 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:17:29.809897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.810787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.818256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.818872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.819429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.820525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.821068 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.821649 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.845412 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:29.845948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:29.852871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.853396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.853826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.854553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.855012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.855437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.881088 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:17:29.882541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:29.883270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:29.883794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:29.884325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'fault' on Instance uuid 87baeec7-935c-4c71-87db-693080de3051 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:29.935360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:29.943595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1376fe60-6641-4fbf-a90c-788ad5f174c2 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 200 len: 1311 microversion: 2.1 time: 0.141356 Sep 07 13:17:29.954453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 324/644] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:29 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:30.009163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-13c8a4d5-b980-4181-b5f6-b6aa2d727e25 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 204 len: 0 microversion: 2.1 time: 0.167811 Sep 07 13:17:30.009665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 321/645] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:17:29 2022] DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:17:30.019833 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:30.020943 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:30.028064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.028686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.029012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e569be-2078-4315-8e69-36bdcd41f72b", "tag": "45ce7ccd-3b28-43db-b224-41a2885c97fe"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:30.029163 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.029812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.030264 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.030710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.039622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.040188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.040639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.052994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] Creating event network-changed:45ce7ccd-3b28-43db-b224-41a2885c97fe for instance 70e569be-2078-4315-8e69-36bdcd41f72b on hv-cinder-79053 Sep 07 13:17:30.058367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-70420013-b9cf-4c76-a74b-0c76b05eb7f4 req-61f2dcbb-c48e-429f-aa16-6707cae7c0fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034935 Sep 07 13:17:30.058996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 322/646] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:30.164635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:30.172274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fb0e0358-fb80-4566-8b01-324dac68af9f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1679 microversion: 2.1 time: 0.157953 Sep 07 13:17:30.172964 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 325/647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:30 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:30.968656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:30.969267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 87baeec7-935c-4c71-87db-693080de3051] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:30.976096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.976584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.977015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.977700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:30.978154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:30.978604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:30.991719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] HTTP exception thrown: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Request method failure captured: Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 HTTP/1.1 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhaui2HLaVmzSyWD7xmJnx7cxSyM9KR_w_2EG9rAfoc8wO3BASPxSFNmhIsZFRLS-NhxX7k46xSthReO20TPNHaDj9pnzEhHNnH-EiLztw8qz4cYSBG18Zcx0DfjUtQRbBxt5MxP_yPAQx1e3IfkTI_Hf2jMO78c-nKorRLfv-ReB4 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:17:30.993384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb085890f54a44be94190bd67485bc2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: d5a9fcebd3164b59893658ad92dfcafb Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. Sep 07 13:17:30.995048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '87baeec7-935c-4c71-87db-693080de3051'} Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:30.995903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. Sep 07 13:17:30.997163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:30.998327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Returning 404 to user: Instance 87baeec7-935c-4c71-87db-693080de3051 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:30.998327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a8bd3175-b725-4a32-8ce9-536d1c55ef0d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051" status: 404 len: 111 microversion: 2.1 time: 0.030437 Sep 07 13:17:30.998327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 323/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:30 2022] GET /compute/v2.1/servers/87baeec7-935c-4c71-87db-693080de3051 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:31.005774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.005774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.012559 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.013125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.013636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.014475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.014939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.015490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.042384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:17:31.120867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-24e74657-914b-4fce-9eb6-c4014efe4306 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "DELETE /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 204 len: 0 microversion: 2.1 time: 0.120473 Sep 07 13:17:31.121458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 326/649] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:17:30 2022] DELETE /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:17:31.131030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.131646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.137691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.138167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.138632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.139311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.139760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.140209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.197884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:31.198628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:31.206626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.207388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.207870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.208683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:31.209146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:31.209574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:31.276082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.283754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5d6bfbf4-dfca-4b43-8e7d-982d044cda3f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.157920 Sep 07 13:17:31.284321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 324/650] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:31.346003 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:31.354396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4923e740-e59f-4a22-b581-3a11b4671446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1679 microversion: 2.1 time: 0.160614 Sep 07 13:17:31.355064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 327/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:31 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:32.306639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.307284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.313671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.314156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.314633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.315323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.315785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.316211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.319606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:32.378596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:32.380103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:32.386549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.387042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.387486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.388182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:32.388644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:32.389070 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:32.451121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.459464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5ffd49ba-f36b-4935-9014-a64ec3f314fb tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.156653 Sep 07 13:17:32.460042 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 325/652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:32.524183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:32.531857 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a68f72cf-bd9b-4941-afb6-ef977a092155 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1679 microversion: 2.1 time: 0.157225 Sep 07 13:17:32.532422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 328/653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:32 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:33.482317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:33.482967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:33.489781 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.490255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.490711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.491391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.491840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.492265 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.556191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:33.556815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:33.563191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.563676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.564116 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.564809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:33.565270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:33.565701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:33.627378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:33.635364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7c16e60-4e68-44c0-83ed-10f67dd1b79d tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.156920 Sep 07 13:17:33.636165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 326/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:33 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:33.703573 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:33.711677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d93bc89f-0f93-44a9-851d-33157b804ffa tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1679 microversion: 2.1 time: 0.159387 Sep 07 13:17:33.712239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 329/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:33 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:34.658336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:34.659904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:34.667295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.667867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.668585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:34.669363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.670070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.670600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:34.736682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:34.737508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:34.746247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.747102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.747919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:34.748627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:34.749080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:34.749499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.014260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:35.024075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e61ae90e-713d-4d0c-a069-9df40035751a tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1521 microversion: 2.1 time: 0.368844 Sep 07 13:17:35.025195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 327/656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:34 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:35.070889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:35.079899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ee6a55bd-77d0-4ca7-83e3-33ef2039e31d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1679 microversion: 2.1 time: 0.347167 Sep 07 13:17:35.080482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 330/657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:34 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1679 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:35.529888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148b91ad-ea95-4819-8a38-efc0917b5c10", "name": "network-vif-deleted", "tag": "2600cb21-5d65-4406-b4b8-dfb49cee0aaf"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:35.544453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:35.545043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:35.545508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:35.563624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] Creating event network-vif-deleted:2600cb21-5d65-4406-b4b8-dfb49cee0aaf for instance 148b91ad-ea95-4819-8a38-efc0917b5c10 on hv-cinder-79053 Sep 07 13:17:35.570134 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b0490286-2d1e-456e-98c7-6602b7ca8ab3 req-458be9da-6dd7-4341-8fc3-ebf9f0b9a522 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044545 Sep 07 13:17:35.572502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 328/658] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:36.048199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:36.049508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:36.056686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.057452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.058178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.059417 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.060494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.061355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.103452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.103950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.104420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.104985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lazy-loading 'fault' on Instance uuid 148b91ad-ea95-4819-8a38-efc0917b5c10 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:36.106044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:36.106876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:36.114306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.115349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.115953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.116664 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.117122 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.117545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.156105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a9fcebd3164b59893658ad92dfcafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb085890f54a44be94190bd67485bc2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:36.156673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:36.157267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:36.157904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:36.158608 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'fault' on Instance uuid 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:36.166896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-625a11f8-b8e9-4f9a-a177-5afc775a3e9f tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 200 len: 1311 microversion: 2.1 time: 0.121810 Sep 07 13:17:36.174896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 331/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:36 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:36.209794 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:36.217722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ead6da1c-0698-4fc4-a846-56b64168c7a2 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1330 microversion: 2.1 time: 0.116816 Sep 07 13:17:36.218293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 329/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:36 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:37.191702 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:37.192960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] [instance: 148b91ad-ea95-4819-8a38-efc0917b5c10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:37.199335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.199819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.200499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.201187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.201641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.202058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.215763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] HTTP exception thrown: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Request method failure captured: Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 HTTP/1.1 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhaui2HLaVmzSyWD7xmJnx7cxSyM9KR_w_2EG9rAfoc8wO3BASPxSFNmhIsZFRLS-NhxX7k46xSthReO20TPNHaDj9pnzEhHNnH-EiLztw8qz4cYSBG18Zcx0DfjUtQRbBxt5MxP_yPAQx1e3IfkTI_Hf2jMO78c-nKorRLfv-ReB4 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:17:37.217373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb085890f54a44be94190bd67485bc2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb085890f54a44be94190bd67485bc2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: fb085890f54a44be94190bd67485bc2b Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660191748 Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: d5a9fcebd3164b59893658ad92dfcafb Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660191748-project Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. Sep 07 13:17:37.219062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '148b91ad-ea95-4819-8a38-efc0917b5c10'} Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:37.219875 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. Sep 07 13:17:37.221065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:17:37.222148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] Returning 404 to user: Instance 148b91ad-ea95-4819-8a38-efc0917b5c10 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:37.222148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-536818b1-a111-427e-aae6-86ebb2ac9887 tempest-ServerRescueNegativeTestJSON-660191748 tempest-ServerRescueNegativeTestJSON-660191748-project] 10.222.0.65 "GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10" status: 404 len: 111 microversion: 2.1 time: 0.030923 Sep 07 13:17:37.222148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 332/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:37 2022] GET /compute/v2.1/servers/148b91ad-ea95-4819-8a38-efc0917b5c10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:17:37.241543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:37.242159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:37.248583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.249070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.249516 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.250201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.250683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.251107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.283328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.283807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.284242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.284678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'fault' on Instance uuid 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:37.326692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:37.335171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7b451a2b-c6d7-431b-a50e-a3c48cfab43c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 200 len: 1330 microversion: 2.1 time: 0.098058 Sep 07 13:17:37.335844 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 330/662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:37 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:37.594500 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcd7087-bcdc-489b-8ba6-d784b65e6a10", "name": "network-vif-deleted", "tag": "4345b5d8-f0cd-4479-94b3-078ae0d1ae39"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:37.605662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:37.606372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:37.606928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:37.627044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] Creating event network-vif-deleted:4345b5d8-f0cd-4479-94b3-078ae0d1ae39 for instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 on hv-cinder-79053 Sep 07 13:17:37.632748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-4de581a9-bec1-4691-99ab-c3903e884958 req-4e69609e-9237-492b-8e7d-b9178a9f8ed0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Sep 07 13:17:37.633599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 333/663] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:38.358660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:38.359365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:38.366293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.366975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.367482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.368373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:38.369130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:38.369259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:38.385246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 HTTP/1.1 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:17:38.386932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:17:38.388622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '6dcd7087-bcdc-489b-8ba6-d784b65e6a10'} Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:17:38.389838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:17:38.391328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:17:38.392720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:17:38.392720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b022bb5-cae5-40bb-ad35-0f3e6aee57d5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 404 len: 111 microversion: 2.1 time: 0.033666 Sep 07 13:17:38.392720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 331/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:38 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:17:38.399002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-943d7afa-f2ee-4f0f-8f0d-2a166984b1da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '.version_select at 0x7f7f2b7ba160>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:38.418436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-943d7afa-f2ee-4f0f-8f0d-2a166984b1da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486084023" status: 202 len: 0 microversion: 2.1 time: 0.024744 Sep 07 13:17:38.419007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 334/665] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Sep 7 13:17:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486084023 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:17:39.664087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f407a4d8-e7f1-45ef-9bde-215d88408040 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: .version_select at 0x7f7f2b63b430>, body: {"keypair": {"name": "tempest-keypair-2020608959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/5hZokB2HOq0ld0reqzeQ7MSqq+rxoI5OR75G7dOVTEboBipNinGjegvbgX+UdR8+jtPMviSwkdewhglyv2/Z0W17WyFBAvGxLSSJ6ZX78QpRCh3yxlW1RCdktBKSlcQ=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:39.701042 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f407a4d8-e7f1-45ef-9bde-215d88408040 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:39.705203 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f407a4d8-e7f1-45ef-9bde-215d88408040 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:39.708194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:39.737079 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f407a4d8-e7f1-45ef-9bde-215d88408040 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077784 Sep 07 13:17:39.737679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 332/666] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:17:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:40.515657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:40.517259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:40.525637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.527243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.528407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:40.533759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.534528 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.535181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:40.569460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lazy-loading 'flavor' on Instance uuid d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:17:40.658985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:40.715502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1bbce7a7-fb5f-4068-9257-44f3eb55b11d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "POST /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554/action" status: 202 len: 0 microversion: 2.1 time: 0.205798 Sep 07 13:17:40.716421 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 335/667] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:17:40 2022] POST /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:17:40.726329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:40.727402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:40.746481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.747663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.748406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:40.749482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:40.750132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:40.750784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:41.009365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:41.018741 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c7a7d091-1a60-4b4a-915d-dd84a67c0cb7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.296683 Sep 07 13:17:41.036471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 333/668] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:40 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:41.489701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1894084073", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be10bb5-1b7b-48d3-b1b4-958b66e89a40"}], "security_groups": [{"name": "tempest-securitygroup--2052229446"}], "key_name": "tempest-keypair-2020608959", "user_data": "}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:41.498197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:41.619239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] validate_networks() for [('0be10bb5-1b7b-48d3-b1b4-958b66e89a40', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:17:42.042506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:42.043865 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:42.050780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.051514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.051960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.052667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.053193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.053550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.111314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:17:42.112074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:17:42.112662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:17:42.114372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:17:42.115460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:17:42.125992 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.126718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.127245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.128055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:42.128727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:42.129272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:42.150228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:42.155929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Getting quotas for user 7f5f4eede0b2477896c9f245ac16edad and project 156cb3d94f024131809dbc51cb80f302. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:42.175897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:17:42.180492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:17:42.196087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:42.211736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-71ac9191-739e-4f10-bf28-9ee50fe6f2b1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.172899 Sep 07 13:17:42.212336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 334/669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:42 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:42.239913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8ce8f039-d758-4f0e-adcc-18964e211107 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.755765 Sep 07 13:17:42.240561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 336/670] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:17:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:17:42.251924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e2b21b9d-359f-4c8e-9280-3bddef06f206 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:42.252525 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e2b21b9d-359f-4c8e-9280-3bddef06f206 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:42.350816 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e2b21b9d-359f-4c8e-9280-3bddef06f206 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:42.364432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e2b21b9d-359f-4c8e-9280-3bddef06f206 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1242 microversion: 2.1 time: 0.115766 Sep 07 13:17:42.365216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 335/671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:42 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:43.236364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:43.236991 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:43.244849 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.245349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.245790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.246659 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.247122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.247550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.389853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:43.391233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:43.396066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:43.400836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.401575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.402505 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.403402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:43.404128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:43.404436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8c9fb91c-3892-4c3e-8eaf-fa1288213d2b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.172909 Sep 07 13:17:43.405011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 337/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:43 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:43.406101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:43.773351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:43.784712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-34f1a0cc-86a8-4076-9523-14a5a6c7a7ff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1294 microversion: 2.1 time: 0.400074 Sep 07 13:17:43.788283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 336/673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:43 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1294 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:44.429086 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:44.429663 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.436612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.437220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.437855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.438579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.439226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.439650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.628973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:44.652422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fa258b46-a5c7-45b0-8da4-a53e687c9b39 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.227498 Sep 07 13:17:44.655686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 338/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:44 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:44.809247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:44.809939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:44.816955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.818382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.820071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.820999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:44.821667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:44.822102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:44.952711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:44.964940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f31afabe-2cf5-43a7-a9b9-26db01b25bf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1300 microversion: 2.1 time: 0.159443 Sep 07 13:17:44.965535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 337/675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:44 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:45.679564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:45.679564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:45.685123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.685617 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.686056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:45.687414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.687879 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.688313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:45.820948 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:45.829052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-55ef798b-d737-4383-bd4c-e7849abb20da tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.155651 Sep 07 13:17:45.829637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 339/676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:45 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:45.988868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:45.990155 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:45.996599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.997078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.997540 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:45.998334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:45.998901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:45.999327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.234543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:46.246817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8233e4de-c97f-4fc2-b688-a24fefde421f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.261597 Sep 07 13:17:46.262103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 338/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:45 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:46.419255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa556fc9-e783-44a8-9b61-59c8af007963", "tag": "7192601e-fa4b-47d5-8885-eedb10fa3279"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:46.440814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:46.441983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:46.443904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.465352 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] Creating event network-changed:7192601e-fa4b-47d5-8885-eedb10fa3279 for instance fa556fc9-e783-44a8-9b61-59c8af007963 on hv-cinder-79053 Sep 07 13:17:46.471639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-53eaa627-fa5a-4454-9c64-7459b630ba9a req-b8d2a690-fea3-47f6-baea-981c1b5262b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055389 Sep 07 13:17:46.473182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 340/678] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:46.857637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:46.858729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:46.872615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:46.873468 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:46.874116 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:46.875929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:46.877586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:46.879173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.097219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:47.113396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8648863d-e243-4a68-80ee-a66d6db74093 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.263005 Sep 07 13:17:47.114848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 339/679] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:46 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:47.271685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:47.272843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:47.291094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.291959 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.292639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.299792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:47.301626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:47.302353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:47.581085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:47.590444 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bac7680b-269d-49c5-9412-ce26923c1347 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.324374 Sep 07 13:17:47.591732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 341/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:47 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:48.137346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:48.138667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:48.156778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.157281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.158430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.159172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.159731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.160171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.301620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0c55edcf-9b5a-4100-8130-a5b5b6268389 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: .version_select at 0x7f7f2b6081f0>, body: {"keypair": {"name": "tempest-keypair-1673805328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxs3C/RGvKnt35y+pkTANEJvFHcQBfBgEH2ms9riypfDpRZwBF+xwNOw6by9W4GYVkYHkYREnwfPyHSaROwmMv9/gpfh8TnYtrcOJq0tg+cphlgJ/sc29M3HXL/XaV/Fw=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:48.321193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0c55edcf-9b5a-4100-8130-a5b5b6268389 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for project c32197c49dda403aa8c184ca2c7426ab. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:48.326248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0c55edcf-9b5a-4100-8130-a5b5b6268389 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for user 31e08e973fed47618d748df8defa665b and project c32197c49dda403aa8c184ca2c7426ab. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:48.332228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:48.343789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dd3d2e25-0784-4710-a5ac-abc547ddc418 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.210240 Sep 07 13:17:48.344653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 340/681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:48 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:48.351170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0c55edcf-9b5a-4100-8130-a5b5b6268389 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.190015 Sep 07 13:17:48.351937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 342/682] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Sep 7 13:17:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 07 13:17:48.613686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:48.614870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:48.623442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.624201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.624749 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.625524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:48.626046 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:48.626566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:48.863772 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:48.873960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-14bf2ea5-07bf-4d3d-a1de-cc4517c13232 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.264448 Sep 07 13:17:48.889104 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 341/683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:48 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:49.368055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:49.368681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:49.375583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.376064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.376512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.377197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.377657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.378085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.605999 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:49.614148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d1d5ad30-dab0-48f0-91d9-b64c4f58c2b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.250695 Sep 07 13:17:49.615386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 343/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:49 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:49.814298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1303083465", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc576b82-456a-4c5e-b736-a73bc3dcc5eb"}], "security_groups": [{"name": "tempest-securitygroup--2025420699"}], "key_name": "tempest-keypair-1673805328", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:49.898695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:49.899325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:49.905441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.905929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.906377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.907133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:49.907595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:49.908024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:49.919996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] validate_networks() for [('cc576b82-456a-4c5e-b736-a73bc3dcc5eb', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:17:50.323423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:50.343514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-95ef6d1f-a11d-4bcf-a0a6-8a99685077a0 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.448680 Sep 07 13:17:50.344355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 344/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:49 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:50.402296 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:17:50.402748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:17:50.403394 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:17:50.403804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:17:50.404220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:17:50.416539 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.417026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.417462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.418193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.418672 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.419100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.436785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for project c32197c49dda403aa8c184ca2c7426ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:17:50.440866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for user 31e08e973fed47618d748df8defa665b and project c32197c49dda403aa8c184ca2c7426ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:17:50.455017 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:17:50.457486 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:17:50.517986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2e36c3e9-283f-4b8b-87df-a75ebec7b161 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.708063 Sep 07 13:17:50.519331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 342/686] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Sep 7 13:17:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 07 13:17:50.530665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:50.532335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:50.643045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:50.643732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:50.652469 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.653392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.654297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.655335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:50.655827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:50.656338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:50.657623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:50.665913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:50.668303 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:50.669753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-519e3147-66de-4d94-ab35-345073a8a387 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1282 microversion: 2.20 time: 0.143430 Sep 07 13:17:50.672028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 345/687] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:50 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:50.823528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:50.833908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d779250c-41a2-4c44-8ac2-28b8ba77ad4e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.199134 Sep 07 13:17:50.834519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 343/688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:50 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:51.371833 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:51.372613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:51.379430 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.379928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.380439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.381210 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.381664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.382131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.528049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.538756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-875bc195-e798-4865-96f0-94896b54ee1f tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.170451 Sep 07 13:17:51.557899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 346/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:51 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:51.703828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:51.704545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:51.706465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa556fc9-e783-44a8-9b61-59c8af007963", "name": "network-vif-plugged", "status": "completed", "tag": "7192601e-fa4b-47d5-8885-eedb10fa3279"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:51.720390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.724101 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.724616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.725053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.725769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.726238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.726703 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.728888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.729477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.746676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] Creating event network-vif-plugged:7192601e-fa4b-47d5-8885-eedb10fa3279 for instance fa556fc9-e783-44a8-9b61-59c8af007963 on hv-cinder-79053 Sep 07 13:17:51.753624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-2fb34fa9-3b5c-4d91-9fb2-a8152d176186 req-549d2b28-1c46-4ddd-816e-d4858be30de6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059991 Sep 07 13:17:51.754753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 344/690] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:51.798659 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.807924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.809605 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:51.810831 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ce8fe96a-8ec9-4507-b24e-8d6c838ad634 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1334 microversion: 2.20 time: 0.114193 Sep 07 13:17:51.811467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 347/691] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:51 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:51.859181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:51.859887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:51.866227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.866745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.867172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:51.867855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:51.868303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:51.868721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.008133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.013824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:52.023202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0fa54a38-7e45-474d-a0d9-841606e84850 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.167999 Sep 07 13:17:52.023893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 345/692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:51 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:52.560950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:52.561556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:52.563892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:52.570850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.571350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.571790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.572496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.572956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.573382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.720638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.729203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb95d1f3-ed97-4d3e-981e-c019c341b58c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.172139 Sep 07 13:17:52.729826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 348/693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:52 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:52.837253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:52.837869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:52.843903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.844382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.844815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.845496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:52.845950 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:52.846372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:52.908759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.916932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.918438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:52.919536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6b78ee96-d383-4f6b-8fd0-df81d7a14e9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1340 microversion: 2.20 time: 0.086801 Sep 07 13:17:52.920102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 346/694] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:52 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:53.047769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:53.048817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:53.055289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.055967 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.056416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.057139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.057600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.058028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.188029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:53.195698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8c858adb-dc96-4380-939d-002503f604ef tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.151886 Sep 07 13:17:53.196253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 349/695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:53 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:53.752094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:53.752709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:53.758854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.759447 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.759888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.760596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.761080 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.761578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.944530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:53.945176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:53.952023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.952512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.953311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.953639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:53.954103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:53.954558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:53.987530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:53.996087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-490b3b59-9303-452e-8b9a-c3dad3bed7c5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1368 microversion: 2.1 time: 0.247803 Sep 07 13:17:53.996838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 347/696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:53 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:54.018982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:54.027916 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:54.029387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:54.031059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d974c331-d9bb-4a27-8b88-2dff12747988 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1340 microversion: 2.20 time: 0.090379 Sep 07 13:17:54.031627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 350/697] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:53 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:54.219075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:54.219691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:54.226217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:54.226756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:54.227383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:54.228492 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:54.228728 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:54.229279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:54.413839 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:54.421843 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c983ebdd-9a6d-47d5-8e13-47c0d7954ad8 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.206501 Sep 07 13:17:54.433196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 348/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:54 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:55.019340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:55.020007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:55.027430 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.027917 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.028351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.029206 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.029667 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.030208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.055417 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:55.056682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:55.073753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.074248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.074732 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.075440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.075900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.076329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.174686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:55.183457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ecab435f-3045-4606-a908-24a514b16b99 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1558 microversion: 2.1 time: 0.168084 Sep 07 13:17:55.184325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 351/699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:55 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:55.210800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:55.211389 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:55.219361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.219890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.220335 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.221043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.221780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.221933 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.261419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:55.269878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:55.272078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:55.273202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-88657410-73f6-4bbc-86a0-3c951caa1fd9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.221727 Sep 07 13:17:55.273771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 349/700] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:55 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:17:55.303678 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3763390e-7d82-4f3c-9ca0-ae66fb1e2990 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096901 Sep 07 13:17:55.311384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 352/701] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Sep 7 13:17:55 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:55.446045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:55.447112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:55.454950 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.456052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.456929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.458715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.460326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.460767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.646963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:55.654829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-42e8eec5-e2af-41fd-b0ce-fdfd03507d27 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.213496 Sep 07 13:17:55.655408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 350/702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:55 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:55.737387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:55.754124 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:55.754640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:55.755764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:55.770057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] Creating event network-changed:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:17:55.783144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-df8cdf4f-fad5-46d0-868d-8deb2581649d req-92bbfde3-2bd3-43b4-a883-be251b89225c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054198 Sep 07 13:17:55.783968 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 353/703] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:17:56.299530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:56.301197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:56.308775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:56.309477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:56.310562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.311431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:56.311885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:56.312502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.473469 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa556fc9-e783-44a8-9b61-59c8af007963", "tag": "7192601e-fa4b-47d5-8885-eedb10fa3279"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:56.484492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:56.485224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:56.485503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:56.486027 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.496431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:56.497952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:56.498882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] Creating event network-changed:7192601e-fa4b-47d5-8885-eedb10fa3279 for instance fa556fc9-e783-44a8-9b61-59c8af007963 on hv-cinder-79053 Sep 07 13:17:56.499341 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-055142ea-0a38-4f6f-b38d-12c6f48964a2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.204302 Sep 07 13:17:56.500443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 351/704] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:56 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:56.504029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-0abc8e48-d04e-4e64-9ef0-e2be43eec867 req-85d39dff-48f7-4830-8e01-a00b30e55765 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035438 Sep 07 13:17:56.504852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 354/705] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:17:56.680205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:56.680918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:56.687048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:56.687604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:56.688113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.688869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:56.689387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:56.689899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:56.829177 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:56.837519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ee640d1b-2f52-40e2-b42d-3aa39ff65f3d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.161731 Sep 07 13:17:56.838103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 352/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:56 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:57.525963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:57.526633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:57.533282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.533757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.534195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:57.534928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.535382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.535807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:57.678776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:57.688216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:57.689760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:57.691062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9ccbd74b-b95b-4b14-bc4a-cdb0b0b0d7d7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.169570 Sep 07 13:17:57.691692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 355/707] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:57 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:57.863918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:57.864656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:57.871992 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.873118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.873599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:57.874444 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:57.875002 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:57.875652 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:58.367987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:58.376120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d000c6c2-1f68-407e-9ffe-792b5f627f6b tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.518213 Sep 07 13:17:58.376687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 353/708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:57 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:58.717195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:58.717816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:58.724964 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:58.725458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:58.725901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:58.726636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:58.727095 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:58.727528 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:58.730553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:58.864327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:58.872973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:58.874441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:58.875550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a4f9c4f1-0f68-4eee-a9e7-9669bf639b1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.162444 Sep 07 13:17:58.876107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 356/709] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:58 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:17:59.399976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:59.400597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:59.407028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.407511 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.407958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.408647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.409107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.409536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.538727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:17:59.546913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-94c4a46d-50fa-416c-830d-6b3f3a5b1b91 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.151268 Sep 07 13:17:59.547649 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 354/710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:17:59 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:17:59.901053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:17:59.901668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:17:59.908100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.908583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.909023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:59.909710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:59.910168 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:59.910628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.043054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.051352 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.052882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.053998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-683de630-4bce-4514-84dd-8c8f700deee4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.156875 Sep 07 13:18:00.054581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 357/711] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:17:59 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:00.572283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:00.572902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:00.575223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:00.575924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=12 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:00.582283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.582794 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.583226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.583914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:00.584397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:00.584779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:00.724942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:00.733379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a0ae3b00-57d8-45df-82c6-61f5a23d4f4a tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.165864 Sep 07 13:18:00.733995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 355/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:00 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:01.079120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:01.079733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.081608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=12 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:01.087336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.087822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.088262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.088950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.089403 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.089828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.219778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.229092 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.230596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.231700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fae2bd83-0ea4-4826-b5bb-3564ffeef5f2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.156749 Sep 07 13:18:01.232272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 358/713] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:01 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:01.716290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "name": "network-vif-plugged", "status": "completed", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:01.726946 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.727431 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.727905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.739123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] Creating event network-vif-plugged:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:18:01.744631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-8094a473-0764-4c8b-873c-9204b4ee3c62 req-18c603c1-6c3c-43e5-94dc-cacb57221aea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032110 Sep 07 13:18:01.745228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 356/714] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:01.757029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:01.757772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.763748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.764239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.764714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.765413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.765872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.766305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.903288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:01.911045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a19e98d1-4fac-4f9a-9aa0-2a5d5638dacc tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1505 microversion: 2.1 time: 0.157984 Sep 07 13:18:01.911607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 359/715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:01 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:01.935446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:01.936151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:01.942231 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.942763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.943235 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.943936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:01.944392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:01.944820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:01.992465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120738) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:18:02.059329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7bd265f7-fbd7-4152-b60e-6f700275f3c7 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "POST /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554/action" status: 202 len: 0 microversion: 2.1 time: 0.128126 Sep 07 13:18:02.059949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 357/716] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:18:01 2022] POST /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:02.068042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:02.068664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:02.076438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.076933 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.077774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.078513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.079084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.079516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.223397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.231969 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a255913b-9c0a-4aa8-9e5a-351066d4887c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1513 microversion: 2.1 time: 0.167740 Sep 07 13:18:02.232543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 360/717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:02 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:02.257472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:02.258091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:02.264401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.264887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.265322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.266016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:02.266491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:02.266919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:02.404930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.413697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.415171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:02.416282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-63ffa2a7-08d1-4694-84e6-7a244fd1d690 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.163121 Sep 07 13:18:02.416890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 358/718] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:02 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:03.257290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:03.257896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:03.264404 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.264917 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.265344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.266025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.266498 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.266921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.400252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.408337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d168f80d-650c-4553-80b8-05c06429dbbd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1515 microversion: 2.1 time: 0.156776 Sep 07 13:18:03.409021 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 361/719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:03 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:03.441719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:03.442478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:03.449403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.449911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.450331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.451058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.451521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.451956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.589030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.597753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.599295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:03.601474 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-feae3a5c-cfc8-42ce-b8aa-bd907ced804d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1408 microversion: 2.20 time: 0.163601 Sep 07 13:18:03.619113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 359/720] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:03 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:03.761192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "name": "network-vif-unplugged", "status": "completed", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:03.770246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:03.770753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:03.771184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:03.782823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.compute.server_external_events [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] Unable to find a host for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554. Dropping event network-vif-unplugged {{(pid=120737) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 13:18:03.783623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-00977e97-d377-43d8-97b8-56d8deb6ab2d req-3280aa82-4686-4c1e-ae52-8d11d60576f3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026406 Sep 07 13:18:03.784194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 362/721] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 13:18:04.432506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:04.433838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:04.439822 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.440302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.440738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.441428 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.441883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.442488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.582521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.590827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-599411fe-8d3b-4852-a932-73f5e1864797 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.162501 Sep 07 13:18:04.591387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 360/722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:04 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:04.625671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:04.626278 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:04.633235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.633710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.634144 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.634873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.635326 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.635744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.765911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.774647 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.776126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:04.777273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bf3c1add-eacf-4a64-a177-eea174673bf5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1599 microversion: 2.20 time: 0.155449 Sep 07 13:18:04.777918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 363/723] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:04 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:04.803166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:04.803667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:04.809569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.810056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.810526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.811225 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:04.811681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:04.812106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:04.888983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d6aa69c7-8fa0-40d4-876d-a7c46aff2c3e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089742 Sep 07 13:18:04.889590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 361/724] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Sep 7 13:18:04 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:18:05.614219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:05.614809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:05.622173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.622711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.623150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.623848 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:05.624321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:05.624733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:05.767150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:05.776726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4089be8b-bd14-4250-b00a-b166a18660b5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.166252 Sep 07 13:18:05.777418 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 364/725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:05 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:06.520981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:06.530445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.530941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.531379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.545101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] Creating event network-changed:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:18:06.550039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-fdff7711-12bd-44aa-9c2b-5158c566c183 req-b41c6229-7df0-48ed-a1b2-d47c0fd8252f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033191 Sep 07 13:18:06.550731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 362/726] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:06.801397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:06.802111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:06.809194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.809841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.810399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.811256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:06.811819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:06.812354 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:06.959952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:06.968169 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4ea7892c-f36d-4f82-846e-02cad4ca5681 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.170783 Sep 07 13:18:06.968739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 365/727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:06 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:07.993621 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:07.994247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:08.000751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.001241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.001681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.002372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.002862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.003288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.008112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:08.139562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:08.147737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-da4257c6-a22d-4bbe-a9dc-1a44ea1ac915 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.159340 Sep 07 13:18:08.148310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 363/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:07 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:09.171466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:09.172089 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:09.178778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.179299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.179740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.180437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:09.180894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:09.181324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:09.320339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:09.328246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c7452cd9-a3b4-4400-bd75-5bec27b4f07d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.160673 Sep 07 13:18:09.328855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 366/729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:09 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:10.352924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:10.353533 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:10.355944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:10.361087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.361570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.362004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.362730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:10.363182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:10.363599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:10.493968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:10.501661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a132c9ee-f7ea-49bb-9d43-bd87842b2d5e tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.153191 Sep 07 13:18:10.502230 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 364/730] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:10 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:11.525453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:11.525988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:11.528412 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:11.533664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.534156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.534636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.535327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.535786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.536213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.683545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:11.691297 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e5ba31e9-7255-4fe3-9085-c228018f59d4 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.170091 Sep 07 13:18:11.691855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 367/731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:11 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:12.715301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.715917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.723063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.723549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.723987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.724678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:12.725347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:12.725778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:12.858858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:12.867515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4c2df4d0-98a2-4600-b577-4577178b4a14 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.156249 Sep 07 13:18:12.868093 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 365/732] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:13.890098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:13.890742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:13.897382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:13.897892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:13.898334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:13.899050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:13.899511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:13.899941 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:14.031791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:14.039554 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2c770a90-f54a-4774-b230-f9ba9e3e856c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.153301 Sep 07 13:18:14.040121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 368/733] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:13 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:15.063488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:15.064371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:15.071508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.071991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.072427 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.073112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.073564 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.073988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.203731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:15.212636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-611b1de0-8752-4c07-b88c-75b0d0d19d86 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.152955 Sep 07 13:18:15.213223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 366/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:15 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:15.753237 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "name": "network-vif-plugged", "status": "completed", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:15.763632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.764125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.764560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.776049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] Creating event network-vif-plugged:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:18:15.780952 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-6ed14466-4625-41f9-a2d7-07b15f550bed req-1b9338f3-cbed-46ea-ae24-34b8d3b4d983 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Sep 07 13:18:15.781545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 369/735] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:16.235536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:16.236150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:16.242780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:16.243262 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:16.243693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:16.244405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:16.244854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:16.245314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:16.380166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:16.387923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e18ee618-1f67-4960-8d01-612a8fa87b6c tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.156320 Sep 07 13:18:16.388483 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 367/736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:16 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:17.336447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:17.337027 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:17.343198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.343686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.344120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.344811 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.345263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.345688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.369367 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ecada9e9-1472-4990-9578-8ade09869efc tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/ips" status: 200 len: 145 microversion: 2.1 time: 0.037541 Sep 07 13:18:17.369916 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 370/737] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:17 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:17.411755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:17.412405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:17.419179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.419664 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.420101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.420790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.421246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.421666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.561903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:17.570926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1d693b67-286f-4a0d-88b9-b4aca4d0eb8d tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1571 microversion: 2.1 time: 0.163043 Sep 07 13:18:17.571499 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 368/738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:17 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:18.594629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:18.595174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:18.601608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.602096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.602572 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.603266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.603750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.604179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.713486 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d24f81d-72c6-4961-9f7b-8ebab900c64d"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:18.715882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:18.722124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.722647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.723079 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.723768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.724222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.724644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.742722 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:18.750441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2187e129-42a9-427b-8728-8f902a4a6227 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1558 microversion: 2.1 time: 0.159791 Sep 07 13:18:18.751012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 371/739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:18 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:19.020978 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-324cc0c9-4157-4a8b-8c0d-cb4d3753db04 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311315 Sep 07 13:18:19.021613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 369/740] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:18 2022] POST /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:26.573841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:26.576019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:26.582788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.583281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.583723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.584418 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.584881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.585346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.616125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-653498bd-f198-47b0-b9b4-362b332883b7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Sep 07 13:18:26.617587 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 372/741] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:26 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:26.629219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:26.629791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:26.636213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.636690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.637121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.637802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:26.638248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:26.638700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.667312 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2437b774-b776-4532-9f72-470ea0ff47b2 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d" status: 200 len: 194 microversion: 2.1 time: 0.043097 Sep 07 13:18:26.667912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 370/742] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:26 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:27.998393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d95b8ca-2de5-41bb-8fcf-f53497592010"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:28.000739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:28.007160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.007666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.008112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.008807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.009297 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.009732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.177939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:28.294592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e734b066-f098-4745-820c-ef443c7583f5 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "POST /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299920 Sep 07 13:18:28.299710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 373/743] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:27 2022] POST /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:35.846578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.848848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:35.855821 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.856400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.856836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.857523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.857974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.858399 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.889187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b4417b42-94c4-4b93-8921-3e278741558b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046673 Sep 07 13:18:35.889738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 371/744] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:36.040721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.041282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.047635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.048115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.048548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.049226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.049674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.050092 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.078074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cf358a7a-3802-4fd5-8fd5-66ab21b077ed tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d" status: 200 len: 194 microversion: 2.1 time: 0.042249 Sep 07 13:18:36.078671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 374/745] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:36.089174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.090302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.096465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.096945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.097382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.098124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.098602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.099028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.181970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lazy-loading 'services' on Instance uuid 70e569be-2078-4315-8e69-36bdcd41f72b {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:36.252889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-24a0e11f-8e60-408b-8916-c5e1b2b317bd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d" status: 202 len: 0 microversion: 2.1 time: 0.167453 Sep 07 13:18:36.253478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 372/746] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:36 2022] DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/5d24f81d-72c6-4961-9f7b-8ebab900c64d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:38.431792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.432283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.438984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.439467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.439905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.440591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.441045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.441474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.470892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8086d43a-cd38-4fdb-a4c3-809325981bdd tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/2d95b8ca-2de5-41bb-8fcf-f53497592010" status: 200 len: 194 microversion: 2.1 time: 0.042947 Sep 07 13:18:38.471398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 375/747] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/2d95b8ca-2de5-41bb-8fcf-f53497592010 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:38.483712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.484400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.490598 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.491090 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.491529 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.492228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.492663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.493087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.495634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:38.578198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lazy-loading 'services' on Instance uuid 70e569be-2078-4315-8e69-36bdcd41f72b {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:38.648712 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3baa9a97-b27e-4096-8732-cc3f9df4a172 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/2d95b8ca-2de5-41bb-8fcf-f53497592010" status: 202 len: 0 microversion: 2.1 time: 0.170425 Sep 07 13:18:38.649314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 373/748] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:38 2022] DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments/2d95b8ca-2de5-41bb-8fcf-f53497592010 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:39.833185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.835577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.842671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.843156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.843586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.844269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.844713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.845130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.873047 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d2841399-acdc-4e07-8586-05c508a06f23 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045519 Sep 07 13:18:39.873598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 376/749] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:18:39.990818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.993074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.999836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.000318 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.000754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.001438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.001914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.002321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.032241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-19407616-b3ce-45c8-bb39-2f6b825aa09b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045790 Sep 07 13:18:40.032798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 374/750] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:18:40.096574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.097066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.102910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.103373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.103802 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.104478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.104927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.105562 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.130044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:40.216200 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-973d9d62-85c0-448c-861a-981bcc38de7b tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 204 len: 0 microversion: 2.1 time: 0.123127 Sep 07 13:18:40.216787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 377/751] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:40 2022] DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:18:40.227469 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.228136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.234136 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.234661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.235140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.235831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.236290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.236718 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.368444 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:40.376993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-84a81316-971c-4d5f-b15a-a8402f7531e7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1674 microversion: 2.1 time: 0.155354 Sep 07 13:18:40.377568 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 375/752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:41.401718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:41.403041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:41.409345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.409855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.410292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.411006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:41.411463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:41.411887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:41.540979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:41.549462 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-89d25570-9e98-4edb-8ed3-4f39fa54648a tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1674 microversion: 2.1 time: 0.151983 Sep 07 13:18:41.550038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 378/753] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:41 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:42.572888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.573498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.576638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=24 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:42.582215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.582724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.583158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.583847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.584297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.584713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.712434 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:42.720195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4205d20c-ac7a-4bad-bec8-0ec8373b637e tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1674 microversion: 2.1 time: 0.151123 Sep 07 13:18:42.720750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 376/754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:43.458249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.458856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.461161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:43.467476 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.467973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.468420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.469129 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.469585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.470011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.493406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-925d5947-a16c-4225-a545-c71b4f363446 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/ips" status: 200 len: 149 microversion: 2.1 time: 0.039244 Sep 07 13:18:43.493985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 379/755] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:18:43 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:43.747121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:43.747989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:43.755941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.756760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.757424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.758828 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:43.759485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:43.760106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:43.869780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:43.878400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-49101435-830f-44cf-9054-273e4c2242c8 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1606 microversion: 2.1 time: 0.137057 Sep 07 13:18:43.879762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 377/756] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:43 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1606 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:44.149399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e569be-2078-4315-8e69-36bdcd41f72b", "name": "network-vif-deleted", "tag": "45ce7ccd-3b28-43db-b224-41a2885c97fe"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:44.159470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.159966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.160394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.171589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] Creating event network-vif-deleted:45ce7ccd-3b28-43db-b224-41a2885c97fe for instance 70e569be-2078-4315-8e69-36bdcd41f72b on hv-cinder-79053 Sep 07 13:18:44.177468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-cbe99011-bce6-49bd-aea2-56a7cab5b27d req-bd4bfba3-4ad8-4e5b-9904-ef260fb016fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030914 Sep 07 13:18:44.180722 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 380/757] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:44.852100 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e67d257-bdf7-43da-b9bf-8915091ff006"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:44.854643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.862317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.863020 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.863460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.864172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.864615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.865041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.906754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:44.907594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:44.917500 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.919231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.921025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.922629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.923202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.923712 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.963672 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:44.964235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:44.964747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:44.965934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lazy-loading 'fault' on Instance uuid 70e569be-2078-4315-8e69-36bdcd41f72b {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:45.019308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '458eb2f4b67541a69e30b238c7d2a78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3738db936ec4845ac4ac33f78816fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:45.028971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-783f24cc-f7b3-4b1e-aba2-fd0a1ae6c8ef tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 200 len: 1328 microversion: 2.1 time: 0.128799 Sep 07 13:18:45.034701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 381/758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:44 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:45.188981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aa8856f1-df7f-48b2-8afd-fbe72d8fad7e tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "POST /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340280 Sep 07 13:18:45.189734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 378/759] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:18:44 2022] POST /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:46.052757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:46.053361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:46.059714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.060192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.060620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.061306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:46.061759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:46.062182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:46.075637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b HTTP/1.1 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:18:46.077225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:46.078911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '70e569be-2078-4315-8e69-36bdcd41f72b'} Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:46.079957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:46.081786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:46.083198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:46.083198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ff7ba767-d066-40cf-a133-2eafd403fa61 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 404 len: 111 microversion: 2.1 time: 0.030204 Sep 07 13:18:46.083198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 382/760] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:46 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:46.088502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-621deada-0530-4ce5-9ef2-1af42111a785 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '.version_select at 0x7f7f2baabaf0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:46.107952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-621deada-0530-4ce5-9ef2-1af42111a785 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977234134" status: 202 len: 0 microversion: 2.1 time: 0.023982 Sep 07 13:18:46.108547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 379/761] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Sep 7 13:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977234134 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:48.989820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:48.990319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:48.997744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.998246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:48.998712 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:48.999410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:48.999881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.000305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.013876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b HTTP/1.1 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:18:49.015436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.017056 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '70e569be-2078-4315-8e69-36bdcd41f72b'} Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:49.017938 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.019534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.021426 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:49.021426 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3c178265-97d0-452b-84cf-82d696ed760f tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 404 len: 111 microversion: 2.1 time: 0.030798 Sep 07 13:18:49.021426 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 383/762] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:48 2022] DELETE /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:49.026241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:49.027032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 70e569be-2078-4315-8e69-36bdcd41f72b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:49.033983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.034512 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.034959 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.035654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:49.036114 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:49.036544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:49.050636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b HTTP/1.1 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:18:49.052281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.053857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '70e569be-2078-4315-8e69-36bdcd41f72b'} Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:49.054826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. Sep 07 13:18:49.056295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:49.057612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 70e569be-2078-4315-8e69-36bdcd41f72b could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:49.057612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c52c9993-9ed9-4829-a98d-254a7a17d1f7 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b" status: 404 len: 111 microversion: 2.1 time: 0.031859 Sep 07 13:18:49.057612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 380/763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:49 2022] GET /compute/v2.1/servers/70e569be-2078-4315-8e69-36bdcd41f72b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:50.197090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:50.197594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:50.205062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.205818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.206258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.210510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.210510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.210510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.224002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db HTTP/1.1 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:18:50.225643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.227343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '04e96a0f-85ee-4d00-b876-e7bf7d4547db'} Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:50.228485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.230103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.232062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:50.232062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c8fb8f28-4e86-4228-ab1e-1e6b84665ef9 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 404 len: 111 microversion: 2.1 time: 0.033875 Sep 07 13:18:50.232062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 384/764] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:50 2022] DELETE /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:50.238251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:50.238957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] [instance: 04e96a0f-85ee-4d00-b876-e7bf7d4547db] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:50.246370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.246958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.247637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.248567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:50.249030 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:50.249462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:50.264959 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] HTTP exception thrown: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Request method failure captured: Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db HTTP/1.1 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhcjMbBwzblpHMYSUqNwgav6x8d5b_sWUpIgXuivga4Y4x0brDNbq1O1sL23nH5BPOLN4gN0xpJlEeRrRsWyPn7dodXX_RxgpIpYGpZ-TfBHwsn2NBC5zYYbNAC8oXJgeSCYXZUq53oEtAhyDdPGRji_yi7OEi9lkAkyuF-BENLTi8 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:18:50.266731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c3738db936ec4845ac4ac33f78816fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c3738db936ec4845ac4ac33f78816fb1 Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2099241693 Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 458eb2f4b67541a69e30b238c7d2a78b Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeTestJSON-2099241693-project Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.269855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '04e96a0f-85ee-4d00-b876-e7bf7d4547db'} Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:50.270799 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. Sep 07 13:18:50.272223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:18:50.273443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] Returning 404 to user: Instance 04e96a0f-85ee-4d00-b876-e7bf7d4547db could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:50.273443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8241897d-5bc5-4a92-be78-98a5c9da6763 tempest-AttachVolumeTestJSON-2099241693 tempest-AttachVolumeTestJSON-2099241693-project] 10.222.0.65 "GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db" status: 404 len: 111 microversion: 2.1 time: 0.034367 Sep 07 13:18:50.273443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 381/765] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:50 2022] GET /compute/v2.1/servers/04e96a0f-85ee-4d00-b876-e7bf7d4547db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:53.390462 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:53.391050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:53.397600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.398016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.398493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.399249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:53.399734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:53.400034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:53.428227 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ce8329d1-b1ed-447b-a321-ef880dbd3157 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/ips" status: 200 len: 150 microversion: 2.20 time: 0.042645 Sep 07 13:18:53.428999 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 385/766] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Sep 7 13:18:53 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:18:54.032940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:54.033505 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:54.040997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.041403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.041896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.042937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.043402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.043855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.126217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'services' on Instance uuid fa556fc9-e783-44a8-9b61-59c8af007963 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:54.201194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6445b312-903b-45d6-bcc7-02ae1276ecac tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments/0e67d257-bdf7-43da-b9bf-8915091ff006" status: 202 len: 0 microversion: 2.1 time: 0.172553 Sep 07 13:18:54.202040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 382/767] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:54 2022] DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments/0e67d257-bdf7-43da-b9bf-8915091ff006 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:54.215344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:54.219131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:54.225918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.226439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.227176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.229082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:54.229082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:54.229625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:54.264113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b59fff7a-af01-4750-8d2d-03b5bf298ee8 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057373 Sep 07 13:18:54.265455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 386/768] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:54 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:55.144219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1c6ac40e-095a-4889-b499-07c8c0eb3fb2 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Action: 'create', calling method: .version_select at 0x7f7f2b5bb3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-656030020"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:55.277713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:55.281203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:55.288563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.289048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.289484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.290260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:55.290769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:55.291222 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:55.322261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cefc12e1-c21e-4c2d-b0d2-5161cc88ecf5 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048892 Sep 07 13:18:55.322862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 387/769] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:55 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:55.458109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1c6ac40e-095a-4889-b499-07c8c0eb3fb2 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.458319 Sep 07 13:18:55.466565 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 383/770] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Sep 7 13:18:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 07 13:18:55.472239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3a7040ff-e554-4202-87a5-c3461d543232 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b608820>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:55.529285 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3a7040ff-e554-4202-87a5-c3461d543232 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 200 len: 344 microversion: 2.1 time: 0.061368 Sep 07 13:18:55.529963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 388/771] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:55 2022] GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:56.314389 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:56.315064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.322061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.322589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.323031 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.323753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.324218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.324654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.336586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.338740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.346015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.346533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.346966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.347657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.348109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.348533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.349594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lazy-loading 'flavor' on Instance uuid bdbf7c6a-056e-45e0-a43d-682c3c3fda84 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:56.377445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-71680d2f-a0fe-4c14-b512-2aaf12b0ae19 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045552 Sep 07 13:18:56.378010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 389/772] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:18:56.442271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.442797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.448787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.449282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.449717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.450617 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.451581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.452015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.477801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:56.527831 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:56.563460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4148ae16-6f55-40a8-a9b9-70fdd9e5526a tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 204 len: 0 microversion: 2.1 time: 0.124542 Sep 07 13:18:56.564537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 390/773] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:56 2022] DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:18:56.571382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9fb87004-750a-451a-9c3b-2c970f62a456 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b6083a0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.591963 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-00f772f3-2544-49ce-8743-f7beeb0259f8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/action" status: 202 len: 0 microversion: 2.20 time: 0.281345 Sep 07 13:18:56.595907 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 384/774] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Sep 7 13:18:56 2022] POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:18:56.598497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.599242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.605835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.606323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.606834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.608153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.608650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.609171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.621492 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9fb87004-750a-451a-9c3b-2c970f62a456 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 200 len: 345 microversion: 2.1 time: 0.055692 Sep 07 13:18:56.622054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 391/775] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:56.627867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.628607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:56.635288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.635785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.636221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.636920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:56.637379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:56.637809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:56.754121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:56.762074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4a9d7224-69b0-4009-84d0-d253168c0ba7 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1682 microversion: 2.1 time: 0.167717 Sep 07 13:18:56.762678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 385/776] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:56.769580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8d74684d-263f-4200-b398-7f5e2eab6b04 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Action: 'create', calling method: .version_select at 0x7f7f2b5e3940>, body: {"snapshot": {"volume_id": "69ad8409-69fd-491b-b721-bf788870dba9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1457725077"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:56.787007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:56.795474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:56.797002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:56.798165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b421bf71-77ae-49c7-914b-20945a667cf3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.175096 Sep 07 13:18:56.798771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 392/777] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:18:56.916357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8d74684d-263f-4200-b398-7f5e2eab6b04 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152528 Sep 07 13:18:56.916975 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 386/778] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Sep 7 13:18:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:56.928656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-061803fb-f8fc-4ec7-887f-2584674b006d tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b6603a0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:56.960142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-061803fb-f8fc-4ec7-887f-2584674b006d tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.035331 Sep 07 13:18:56.960704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 393/779] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:56.971912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d299429-275d-4943-b84f-fe4a4f668c9a tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b648160>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:57.002924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3d299429-275d-4943-b84f-fe4a4f668c9a tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034681 Sep 07 13:18:57.003442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 387/780] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Sep 7 13:18:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:57.014573 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c2f4c2ee-d8fa-46cb-bdd9-729d3e83d5ec tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b660790>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:57.043097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c2f4c2ee-d8fa-46cb-bdd9-729d3e83d5ec tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.032540 Sep 07 13:18:57.043692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 394/781] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:57 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:57.786838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:57.788109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:57.794125 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.794701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.795246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.795929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.796387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.796811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.824610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:57.825220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:57.832647 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.833133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.833564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.834246 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:57.834748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:57.835169 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:57.928448 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.936589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7ae9b7b2-4e2c-4cf5-bf90-577d3b32b033 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1682 microversion: 2.1 time: 0.154058 Sep 07 13:18:57.937152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 388/782] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:57 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:57.978366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.987274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.988741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:57.989926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7d866202-560c-4c85-b7a5-3b25368fd269 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.169636 Sep 07 13:18:57.990537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 395/783] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:57 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:18:58.056798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6e46c070-75fe-47e2-a47c-72a565bac2c4 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b836ee0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:58.086391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6e46c070-75fe-47e2-a47c-72a565bac2c4 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.033477 Sep 07 13:18:58.086968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 389/784] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:58 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:58.960257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:58.960874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:58.967955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.968439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.968874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:58.969561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:58.970015 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:58.970457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.019566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:59.020158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:59.026241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.026756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.027257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.027944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:59.028392 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:59.028813 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:59.100990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.108780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fea1459e-2c55-413a-8c93-69e9929048af tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1682 microversion: 2.1 time: 0.152607 Sep 07 13:18:59.109653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 396/785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:58 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:59.114012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9807e6ed-ae0d-4bc9-8a4b-d177d2f3d1b1 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b676f70>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:59.145096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9807e6ed-ae0d-4bc9-8a4b-d177d2f3d1b1 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.034414 Sep 07 13:18:59.145658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 397/786] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:18:59 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:59.164129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.172412 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.173875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:59.175140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-febb6261-8b91-47bc-821e-987986d132df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.159926 Sep 07 13:18:59.175643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 390/787] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:18:59 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:00.133186 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:00.133794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:00.140361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.140839 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.141271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.141951 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.142400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.142847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.157549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc956c0e-660a-4eba-a4d5-f7d744c7047e tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b5bb3a0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:00.187731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fc956c0e-660a-4eba-a4d5-f7d744c7047e tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.034467 Sep 07 13:19:00.188313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 391/788] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:19:00 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:00.200453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:00.201613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:00.209900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.210808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.211627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.212587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:00.213343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:00.214244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:00.235418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:00.289087 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:00.297175 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9a2d2810-bb1a-42b2-b41e-7b39c4bd4d2d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1682 microversion: 2.1 time: 0.168322 Sep 07 13:19:00.297753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 398/789] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:00 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:00.360169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:00.368359 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:00.369897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:00.371098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d05f2f8d-e48f-4c66-a38b-221f6d33c8b3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.174362 Sep 07 13:19:00.371662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 392/790] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:00 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:01.200478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-57884618-5b1a-4bca-ab3c-a760813bdc1f tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b676af0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.231372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-57884618-5b1a-4bca-ab3c-a760813bdc1f tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 288 microversion: 2.1 time: 0.034664 Sep 07 13:19:01.231941 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 399/791] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:19:01 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:01.243818 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-863a43f4-b62e-490a-9a52-8d622f23ffff tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b836160>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.303556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-863a43f4-b62e-490a-9a52-8d622f23ffff tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 202 len: 0 microversion: 2.1 time: 0.063500 Sep 07 13:19:01.304150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 393/792] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Sep 7 13:19:01 2022] DELETE /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:01.313512 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-abf4bb93-1f78-4996-b6c3-37930c0df0bd tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b629160>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.320920 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.321659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:01.329344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.329909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.330458 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.331498 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.332223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.332741 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.346185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-abf4bb93-1f78-4996-b6c3-37930c0df0bd tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 200 len: 287 microversion: 2.1 time: 0.037719 Sep 07 13:19:01.346847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 400/793] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:19:01 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:01.401499 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:01.402218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:01.409129 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.409622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.410062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.410785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:01.411244 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:01.411671 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:01.544318 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.553337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.554808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.556025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-04ecd8a8-db03-4c12-81de-f582cacb7394 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.161290 Sep 07 13:19:01.556582 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 401/794] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:01 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:01.563814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:01.574050 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6721e660-0c23-4e6e-8827-d1a00dd20771 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1682 microversion: 2.1 time: 0.256880 Sep 07 13:19:01.574790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 394/795] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:01 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:02.282262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa556fc9-e783-44a8-9b61-59c8af007963", "name": "network-vif-deleted", "tag": "7192601e-fa4b-47d5-8885-eedb10fa3279"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:02.296131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.297477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.297922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.311446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] Creating event network-vif-deleted:7192601e-fa4b-47d5-8885-eedb10fa3279 for instance fa556fc9-e783-44a8-9b61-59c8af007963 on hv-cinder-79053 Sep 07 13:19:02.316922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-daae6b8f-cfa1-465e-961d-eb401b610d4a req-afa13424-5964-4495-9d5f-2b6b0c2b9a33 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040066 Sep 07 13:19:02.318352 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 402/796] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:02.359306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b0adc24-6206-4377-ac5d-cdd181d4ca3c tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b61f700>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.388364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-0b0adc24-6206-4377-ac5d-cdd181d4ca3c tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] HTTP exception thrown: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b0adc24-6206-4377-ac5d-cdd181d4ca3c tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Request method failure captured: Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 HTTP/1.1 Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJo-QO4jbectv_av1ynebAaVq7GMp25Kya04MMBregMEGjNPiPF8ei8Au0QK6SaJTYHT13-_rN1XmPwnvHZUJboZNAHtyl0MCV5hl-ON-iK6Ow4wTNxXU4M5_FKH2LG8Q2viQlgaPY_qvIyLRfUqOIp6IYmW3iXw1aB0KHphKERwjJg Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:02.391247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bfa732c98ef244eba5473ba1185e766d Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '6749ef7b-2cb2-4099-b300-6e0a14651894'} Sep 07 13:19:02.392949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. (HTTP 404) (Request-ID: req-03095722-01c0-4105-9bf2-c93097dc6d73) Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.394048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:02.395562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 13:19:02.396988 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. Sep 07 13:19:02.398857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:02.401942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b0adc24-6206-4377-ac5d-cdd181d4ca3c tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Returning 404 to user: Snapshot 6749ef7b-2cb2-4099-b300-6e0a14651894 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:02.403043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0b0adc24-6206-4377-ac5d-cdd181d4ca3c tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894" status: 404 len: 111 microversion: 2.1 time: 0.047942 Sep 07 13:19:02.403617 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 395/797] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/os-snapshots/6749ef7b-2cb2-4099-b300-6e0a14651894 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:02.413274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f3c40361-efc9-4981-908c-7e4e103e0838 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b6293a0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.492658 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f3c40361-efc9-4981-908c-7e4e103e0838 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 202 len: 0 microversion: 2.1 time: 0.083904 Sep 07 13:19:02.493231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 403/798] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:19:02 2022] DELETE /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:02.501706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d1149934-9bc4-4669-bc4a-55652532124f tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b5e5e50>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.562104 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d1149934-9bc4-4669-bc4a-55652532124f tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 200 len: 344 microversion: 2.1 time: 0.063964 Sep 07 13:19:02.562713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 396/799] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:02.582505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.583277 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:02.589783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.590282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.590940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.593311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.598429 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:02.599486 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:02.603085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.605395 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.607260 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.607744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.608196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.616464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.617214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.618019 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.660391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:02.665856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:02.667264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:02.667980 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lazy-loading 'fault' on Instance uuid fa556fc9-e783-44a8-9b61-59c8af007963 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:02.721482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5f4eede0b2477896c9f245ac16edad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156cb3d94f024131809dbc51cb80f302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.731790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-434f1b46-98c2-4c3b-abed-9ffc60406110 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 200 len: 1332 microversion: 2.1 time: 0.136915 Sep 07 13:19:02.732625 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 397/800] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 1332 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:02.767600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.775854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.777463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:02.778930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-442fc14b-515d-4a3d-a248-1f1142f9fc9f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.201272 Sep 07 13:19:02.779641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 404/801] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:02 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:03.576775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-737a547c-a740-43cc-9647-06b545ea2b28 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b591ee0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.605268 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-737a547c-a740-43cc-9647-06b545ea2b28 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] HTTP exception thrown: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-737a547c-a740-43cc-9647-06b545ea2b28 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Request method failure captured: Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 HTTP/1.1 Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJo-QO4jbectv_av1ynebAaVq7GMp25Kya04MMBregMEGjNPiPF8ei8Au0QK6SaJTYHT13-_rN1XmPwnvHZUJboZNAHtyl0MCV5hl-ON-iK6Ow4wTNxXU4M5_FKH2LG8Q2viQlgaPY_qvIyLRfUqOIp6IYmW3iXw1aB0KHphKERwjJg Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:03.607282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bfa732c98ef244eba5473ba1185e766d Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '69ad8409-69fd-491b-b721-bf788870dba9'} Sep 07 13:19:03.609609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. (HTTP 404) (Request-ID: req-6003597a-4c7b-4a2a-92a9-6363b339438a) Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.610697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:03.612223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:19:03.613650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-737a547c-a740-43cc-9647-06b545ea2b28 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Returning 404 to user: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-737a547c-a740-43cc-9647-06b545ea2b28 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 404 len: 109 microversion: 2.1 time: 0.035784 Sep 07 13:19:03.615127 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 398/802] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:03.623125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-22966e34-9a3b-4e6c-ae4a-86bafba3afd8 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b629310>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.650789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-22966e34-9a3b-4e6c-ae4a-86bafba3afd8 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] HTTP exception thrown: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-22966e34-9a3b-4e6c-ae4a-86bafba3afd8 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Request method failure captured: Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 HTTP/1.1 Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJo-QO4jbectv_av1ynebAaVq7GMp25Kya04MMBregMEGjNPiPF8ei8Au0QK6SaJTYHT13-_rN1XmPwnvHZUJboZNAHtyl0MCV5hl-ON-iK6Ow4wTNxXU4M5_FKH2LG8Q2viQlgaPY_qvIyLRfUqOIp6IYmW3iXw1aB0KHphKERwjJg Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:03.652897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: bfa732c98ef244eba5473ba1185e766d Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '69ad8409-69fd-491b-b721-bf788870dba9'} Sep 07 13:19:03.654518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. (HTTP 404) (Request-ID: req-e8095ea7-6db3-4ddd-9cd1-6f3ad28734fb) Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.656123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:19:03.657665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:19:03.659165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-22966e34-9a3b-4e6c-ae4a-86bafba3afd8 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Returning 404 to user: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-22966e34-9a3b-4e6c-ae4a-86bafba3afd8 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 404 len: 109 microversion: 2.1 time: 0.034959 Sep 07 13:19:03.660539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 405/803] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Sep 7 13:19:03 2022] DELETE /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:03.663207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0132c3c-368e-403b-94c5-3296d06ecec5 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Calling method '.version_select at 0x7f7f2b7d2940>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.693071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-d0132c3c-368e-403b-94c5-3296d06ecec5 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] HTTP exception thrown: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0132c3c-368e-403b-94c5-3296d06ecec5 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Request method failure captured: Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 HTTP/1.1 Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJo-QO4jbectv_av1ynebAaVq7GMp25Kya04MMBregMEGjNPiPF8ei8Au0QK6SaJTYHT13-_rN1XmPwnvHZUJboZNAHtyl0MCV5hl-ON-iK6Ow4wTNxXU4M5_FKH2LG8Q2viQlgaPY_qvIyLRfUqOIp6IYmW3iXw1aB0KHphKERwjJg Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:03.695006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dac10a2815a74ee7a0dd29f2883df7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: dac10a2815a74ee7a0dd29f2883df7ef Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423054648 Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bfa732c98ef244eba5473ba1185e766d Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423054648-project Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '69ad8409-69fd-491b-b721-bf788870dba9'} Sep 07 13:19:03.696570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. (HTTP 404) (Request-ID: req-befedde8-d6df-44e3-b662-c64b277cb6d0) Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.698331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:19:03.699750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:19:03.701077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0132c3c-368e-403b-94c5-3296d06ecec5 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] Returning 404 to user: Volume 69ad8409-69fd-491b-b721-bf788870dba9 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d0132c3c-368e-403b-94c5-3296d06ecec5 tempest-VolumesSnapshotsTestJSON-423054648 tempest-VolumesSnapshotsTestJSON-423054648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9" status: 404 len: 109 microversion: 2.1 time: 0.036916 Sep 07 13:19:03.703622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 399/804] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/os-volumes/69ad8409-69fd-491b-b721-bf788870dba9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:03.757608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.758232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:03.765568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.766062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.766530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.767230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.767688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.768117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.781913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 HTTP/1.1 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:03.783508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:03.784889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'fa556fc9-e783-44a8-9b61-59c8af007963'} Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:03.785711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:03.786966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:03.788218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:03.788218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-163dffbd-6290-4d09-b20b-8e5069d9aa4c tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 404 len: 111 microversion: 2.1 time: 0.031197 Sep 07 13:19:03.788218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 406/805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:03.793710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a6d84d23-6894-4ce8-8636-6c6f7d848e20 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '.version_select at 0x7f7f2b591c10>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.805748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:03.806305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:03.813792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.814287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.814748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a6d84d23-6894-4ce8-8636-6c6f7d848e20 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020608959" status: 202 len: 0 microversion: 2.1 time: 0.024523 Sep 07 13:19:03.814895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.818686 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:03.818823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 400/806] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Sep 7 13:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020608959 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:19:03.818924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:03.818924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:03.977377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:03.990725 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:03.994086 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:03.995306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b2838531-6007-4d56-93c1-98eb6b8a1f46 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.194030 Sep 07 13:19:04.001539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 407/807] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:03 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:05.028958 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.029655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.037201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.037709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.038150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.038871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.039323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.039742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.176393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:05.185589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:05.187178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:05.188338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-00c999e2-8720-436b-bc79-1efa1339d406 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.163949 Sep 07 13:19:05.188873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 401/808] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:05.618965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.619534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.626639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.627122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.627579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.628265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.628718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.629137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.643692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 HTTP/1.1 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:05.645495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.647007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'fa556fc9-e783-44a8-9b61-59c8af007963'} Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:05.647907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.649185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.651102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:05.651931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cc481cae-8c53-427d-a251-5d0ecf6de6c3 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 404 len: 111 microversion: 2.1 time: 0.036824 Sep 07 13:19:05.652463 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 408/809] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:05 2022] DELETE /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:05.660520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:05.661232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: fa556fc9-e783-44a8-9b61-59c8af007963] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:05.667247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.667736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.668175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.668954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:05.669335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:05.669760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:05.683847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 HTTP/1.1 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:05.685404 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.687471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'fa556fc9-e783-44a8-9b61-59c8af007963'} Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:05.688443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. Sep 07 13:19:05.689719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:05.690851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance fa556fc9-e783-44a8-9b61-59c8af007963 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:05.690851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1d99c8dc-7eac-4106-bf8c-e0698231089b tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963" status: 404 len: 111 microversion: 2.1 time: 0.030195 Sep 07 13:19:05.690851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 402/810] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:05 2022] GET /compute/v2.1/servers/fa556fc9-e783-44a8-9b61-59c8af007963 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:19:06.215051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.215666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.223866 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.223866 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.224642 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.225687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.226217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.226739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.370065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:06.379147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:06.380803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:06.382162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-150279e7-92ab-4f09-aa6e-ef1f89043b5e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.170835 Sep 07 13:19:06.382683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 409/811] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:06.857154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.857665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.864132 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.864612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.865048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.865725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.866175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.866633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.879807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 HTTP/1.1 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:06.881368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.882926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '6dcd7087-bcdc-489b-8ba6-d784b65e6a10'} Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:06.883705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.884968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.886208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:06.886208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f5c06de6-aa25-4c88-b088-935788f2aeff tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 404 len: 111 microversion: 2.1 time: 0.029390 Sep 07 13:19:06.886208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 403/812] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:06 2022] DELETE /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:06.892387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.893115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 6dcd7087-bcdc-489b-8ba6-d784b65e6a10] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.900051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.900479 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.900973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.901739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.902201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.902656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.916293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 HTTP/1.1 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:06.917820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.919239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '6dcd7087-bcdc-489b-8ba6-d784b65e6a10'} Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:06.920197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. Sep 07 13:19:06.921790 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.923907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 6dcd7087-bcdc-489b-8ba6-d784b65e6a10 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:06.923907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-53e86f75-8e86-477f-8f64-4d8f8f5dd922 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10" status: 404 len: 111 microversion: 2.1 time: 0.031724 Sep 07 13:19:06.923907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 410/813] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/servers/6dcd7087-bcdc-489b-8ba6-d784b65e6a10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:19:06.928107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.928611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.934737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.935218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.935658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.936365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.937078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.937658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.954496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 HTTP/1.1 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:06.956158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.957982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '032b4561-945c-4a3e-b009-d8d4461ea3d0'} Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:06.959066 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.960485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.961945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:06.961945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-db161ff6-c411-4685-9e0a-b098fbb4884d tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 404 len: 111 microversion: 2.1 time: 0.033793 Sep 07 13:19:06.961945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 404/814] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:06 2022] DELETE /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:06.967073 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:06.967687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: 032b4561-945c-4a3e-b009-d8d4461ea3d0] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:06.974689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.975174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.975608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.976299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:06.976748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:06.977170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:06.991718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 HTTP/1.1 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:06.993232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.994936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '032b4561-945c-4a3e-b009-d8d4461ea3d0'} Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:06.995892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. Sep 07 13:19:06.997348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:06.999109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance 032b4561-945c-4a3e-b009-d8d4461ea3d0 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:07.000616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7e2e3763-554a-4d4d-99c8-9f74d9588968 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0" status: 404 len: 111 microversion: 2.1 time: 0.037354 Sep 07 13:19:07.001161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 411/815] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:06 2022] GET /compute/v2.1/servers/032b4561-945c-4a3e-b009-d8d4461ea3d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:19:07.408271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:07.408874 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:07.414840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.415321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.415759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.416441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:07.416897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:07.417323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:07.555286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.564166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.565607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:07.566793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-16acd40b-16a9-4b49-a5ae-f4f5ce71e701 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.162784 Sep 07 13:19:07.567346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 405/816] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:07 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:08.168937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.168937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.173241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.173718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.174160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.174887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.175349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.175783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.189549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c HTTP/1.1 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:19:08.191147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.192719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c'} Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:08.193640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.195115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.197563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:08.197563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ddfc7662-c9fc-4a5d-9c5f-365aaa12d572 tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 404 len: 111 microversion: 2.1 time: 0.031118 Sep 07 13:19:08.197563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 412/817] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:08 2022] DELETE /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:08.210547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.210547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] [instance: a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.214004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.214521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.214959 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.215666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.216336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.216766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.231480 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] HTTP exception thrown: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Request method failure captured: Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c HTTP/1.1 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJhgWUtoJqSs6BkVhFzVfCX86Yxv_9VwHYZZeNQvIHCf4Tgdjh5dKDbAGsPrAUATZbB10G9SemYirL8Z4Ie9nLeNwyWndhkAbBRcoqtX28EJem8VzH-hnsXfgK-4mJPiTsOQKoWrnoBu0tgR5lcEDnSJQHxLzD9SLoeBukLwlp6v8BU Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:08.233055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_156cb3d94f024131809dbc51cb80f302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/156cb3d94f024131809dbc51cb80f302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 156cb3d94f024131809dbc51cb80f302 Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-160783048 Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 7f5f4eede0b2477896c9f245ac16edad Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-160783048-project Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.234793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c'} Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:08.235571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. Sep 07 13:19:08.236808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:08.237935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] Returning 404 to user: Instance a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:08.237935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-77309096-d6cd-4b09-9dfa-0d5d573144da tempest-AttachVolumeNegativeTest-160783048 tempest-AttachVolumeNegativeTest-160783048-project] 10.222.0.65 "GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c" status: 404 len: 111 microversion: 2.1 time: 0.037287 Sep 07 13:19:08.237935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 406/818] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:08 2022] GET /compute/v2.1/servers/a3d5a2fa-13ec-4fc4-ba5c-6b0c64d2bd7c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:08.592750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:08.593915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:08.600125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.600620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.601059 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.601788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:08.602248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:08.602800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:08.742714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:08.752448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:08.754115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:08.755375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5d370853-a411-4104-ac27-8591947f4bf9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.166637 Sep 07 13:19:08.756408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 413/819] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:08 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:09.782003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:09.782738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:09.794629 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.795128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.795571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:09.796277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:09.796739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:09.797170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:10.063895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.071860 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.073309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:10.074514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d2ece4ce-f52a-4326-b9b1-7c0a4011072a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.297161 Sep 07 13:19:10.086487 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 407/820] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:09 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:11.101024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:11.102268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:11.122159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.122854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.123378 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.124286 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:11.125262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:11.126067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:11.285002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:11.295243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:11.298789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:11.301191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ed74f251-6b58-4674-82cc-eb2ecbe32934 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.204042 Sep 07 13:19:11.301878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 414/821] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:11 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:12.327196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:12.329310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:12.335970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.336461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.336992 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.337699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:12.338196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:12.338887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:12.509807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.518906 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.520393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:12.521550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-360759d7-7f8e-4ab6-af3f-410c75f193c5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.198172 Sep 07 13:19:12.522109 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 408/822] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:12 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:13.546217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:13.547516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:13.550233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:13.555729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.556308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.556823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.557597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:13.558097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:13.558569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:13.693931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:13.701996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:13.703632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:13.704884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e0f7bcd1-8f28-4625-8e41-0cd3b8e2429d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.162553 Sep 07 13:19:13.705524 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 415/823] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:13 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:14.404386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bfb9417f-31f5-443c-914b-f62c516b51ab tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5ff9d0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:14.460848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bfb9417f-31f5-443c-914b-f62c516b51ab tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/3025e264-69f0-4490-9c39-ec2964553dbf" status: 200 len: 351 microversion: 2.1 time: 0.062938 Sep 07 13:19:14.461677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 409/824] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:14 2022] GET /compute/v2.1/os-volumes/3025e264-69f0-4490-9c39-ec2964553dbf => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:14.730787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:14.731539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:14.743795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.744513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.746850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.747627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.748131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.748575 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.912679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:14.921001 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:14.923007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:14.924147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-81aab595-e1a8-4a25-9d76-f9cffdf86ea1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.197827 Sep 07 13:19:14.924894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 416/825] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:14 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:15.846082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4d454357-98fd-4f97-a0fe-260beee78d91 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5a8af0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:15.895699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4d454357-98fd-4f97-a0fe-260beee78d91 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/64feb6bd-206f-42c5-81e8-9a1daae2cfc8" status: 200 len: 350 microversion: 2.1 time: 0.054536 Sep 07 13:19:15.896297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 410/826] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:15 2022] GET /compute/v2.1/os-volumes/64feb6bd-206f-42c5-81e8-9a1daae2cfc8 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:15.950773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:15.952241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:15.960079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:15.960661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:15.961191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:15.961892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:15.962355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:15.962813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:16.113362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:16.121845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:16.123312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:16.124587 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1ff9867a-a8a8-463b-8b39-bec5d8aa0a32 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.178450 Sep 07 13:19:16.134850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 417/827] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:15 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:17.151507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.152105 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:17.153961 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:17.160987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:17.161477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:17.161917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:17.162639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:17.163096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:17.163521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:17.303424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:17.303730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e9b76ce1-47e2-4be0-86fd-a02314566bc0 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5b75e0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.318216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:17.319763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:17.321021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-becb4fe9-5b90-43e8-aaa6-8435aff16740 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1744 microversion: 2.20 time: 0.174628 Sep 07 13:19:17.321637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 411/828] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:17.356074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e9b76ce1-47e2-4be0-86fd-a02314566bc0 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/46c1c05c-85b5-4d77-b85f-bb42ba12cdc3" status: 200 len: 351 microversion: 2.1 time: 0.056046 Sep 07 13:19:17.356653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 418/829] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes/46c1c05c-85b5-4d77-b85f-bb42ba12cdc3 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:17.370472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-98773de4-e162-46eb-966b-e063b8d5d500 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b63b430>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.452931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-98773de4-e162-46eb-966b-e063b8d5d500 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086207 Sep 07 13:19:17.454380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 412/830] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:17.469578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-48185008-f352-4b20-a2be-be2e950f7011 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b629940>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.556842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-48185008-f352-4b20-a2be-be2e950f7011 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091489 Sep 07 13:19:17.557406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 419/831] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:17.572849 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef336288-4b8a-4e6a-ac29-7b81901caf27 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5e5e50>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.658853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ef336288-4b8a-4e6a-ac29-7b81901caf27 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090566 Sep 07 13:19:17.659454 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 413/832] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:17.673733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d26b1605-cc61-4c4f-aecb-a64c85ef21ab tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5d3b80>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.772894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d26b1605-cc61-4c4f-aecb-a64c85ef21ab tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103878 Sep 07 13:19:17.774098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 420/833] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:17.788303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5b83824-f90c-4a83-b90a-d6af4ee087af tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b60d940>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.871182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5b83824-f90c-4a83-b90a-d6af4ee087af tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086565 Sep 07 13:19:17.871776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 414/834] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:17.885897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-50a0b74a-7e52-4878-9a6f-8897a285a825 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b676ca0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:17.967101 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-50a0b74a-7e52-4878-9a6f-8897a285a825 tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085048 Sep 07 13:19:17.967669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 421/835] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:17.981792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a8a2e367-de2b-4c1b-a166-bb0c77061e6b tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2b5e5b80>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.065289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a8a2e367-de2b-4c1b-a166-bb0c77061e6b tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087373 Sep 07 13:19:18.066015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 415/836] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Sep 7 13:19:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:18.081162 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7c655d8f-630b-4c20-a48c-6046c3591b8f tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] Calling method '.version_select at 0x7f7f2bb008b0>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.165782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7c655d8f-630b-4c20-a48c-6046c3591b8f tempest-VolumesTestJSON-2120231559 tempest-VolumesTestJSON-2120231559-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089312 Sep 07 13:19:18.166383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 422/837] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Sep 7 13:19:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:18.290563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.291096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:18.297806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.298293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.298758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.299451 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.299908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.300336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.325585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:19:18.349156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.349641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:18.355936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.356497 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.356947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.357650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.358115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.358583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.434695 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-06569d49-c14b-4f1a-9923-0f911fdedfcb tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "DELETE /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 204 len: 0 microversion: 2.1 time: 0.147935 Sep 07 13:19:18.435135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 416/838] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:18 2022] DELETE /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:19:18.448983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.449693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:18.456558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.457103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.457791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.458520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.458983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.459861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.514201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.522563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.524016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.525186 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f3dbcc4d-f4b5-402a-9c2c-696b56cc5094 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1744 microversion: 2.20 time: 0.182136 Sep 07 13:19:18.525750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 423/839] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:18 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:18.592648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.601051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-070890fe-4ffb-4ea8-8d20-8dc53f90517f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1576 microversion: 2.1 time: 0.161180 Sep 07 13:19:18.601623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 417/840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:18 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:19.550237 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:19.550788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.557776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.558268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.558742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.559551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.560076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.560637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.565228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:19.625973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:19.626903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.633157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.633729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.634178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.634913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.635366 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.635785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.697256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.705914 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.707771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.709146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d5eec673-1de6-46de-bbc7-1eef04ba1465 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1744 microversion: 2.20 time: 0.163381 Sep 07 13:19:19.709802 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 424/841] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:19 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:19.779118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.788840 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-230919d1-b9bc-487e-b8f2-0666c3c2005e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1576 microversion: 2.1 time: 0.167285 Sep 07 13:19:19.789424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 418/842] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:19 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:20.048567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "name": "network-vif-plugged", "status": "completed", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:20.059530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.060090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.060559 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.071719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] Creating event network-vif-plugged:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:19:20.076743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-52221109-4d79-41e2-9618-69923b7eea8a req-bc4f625e-a1e1-4c8f-afe3-5188dea2cc3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032524 Sep 07 13:19:20.077336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 425/843] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:20.736831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:20.737449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:20.745663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.746153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.746620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.747321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.747783 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.748209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.813963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:20.814778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:20.821990 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.822541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.822980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.823955 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.824522 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.825004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.957736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:20.966943 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:20.968735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:20.970503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eae69669-099d-49f2-abb8-c1a1fc9017e6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1744 microversion: 2.20 time: 0.239328 Sep 07 13:19:20.974468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:20.983232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-77923ba0-2e52-429a-9bd2-823852edf897 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1576 microversion: 2.1 time: 0.173881 Sep 07 13:19:20.983734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 426/844] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:20 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:20.994759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 419/845] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:20 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1744 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:21.994497 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a", "name": "network-vif-deleted", "tag": "9a5217aa-b7cb-4589-9ba3-784d73d8cf16"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:22.000004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:22.014289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.020323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.022435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.022944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.038160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.038690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.039346 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.041087 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.042565 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.043361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.049687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] Creating event network-vif-deleted:9a5217aa-b7cb-4589-9ba3-784d73d8cf16 for instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a on hv-cinder-79053 Sep 07 13:19:22.063389 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-f8baf447-3d3f-45dd-82bc-764372ad6bad req-985889ec-96bd-483e-aafa-b2c1813088e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075909 Sep 07 13:19:22.063961 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 420/846] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:22.080147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:22.080873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.096594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.097102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.097552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.098274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.103407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.103744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.246948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.263547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2bebe4df-f1c4-4899-8122-def64f23c19d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1224 microversion: 2.1 time: 0.194148 Sep 07 13:19:22.274547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 421/847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:22 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1224 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:22.307381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.322552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.326437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.330794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3939f9c5-63f3-42bc-8da7-1efec2c74613 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.335193 Sep 07 13:19:22.352382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 427/848] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:21 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:23.301559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:23.303167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:23.316293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.317012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.317636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.318692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.322322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.322998 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.353521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:23.359867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:23.361965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:23.376432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.377279 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.379726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.385100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.388667 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.389336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.433759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.436437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.438443 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.445115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lazy-loading 'fault' on Instance uuid be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:19:23.559344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.581194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1cc7773e-75fa-41bc-be27-8a1755acd05d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 200 len: 1183 microversion: 2.1 time: 0.283465 Sep 07 13:19:23.585726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 422/849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:23 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 1183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:23.731502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.744193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.745704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.747161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f064ab5f-5325-4f49-87e4-69a062f4ad3a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.391411 Sep 07 13:19:23.748214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 428/850] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:23 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:24.609524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:24.611521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:24.618949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.623078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.624142 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.625345 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.626045 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.626693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.646844 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] HTTP exception thrown: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Request method failure captured: Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a HTTP/1.1 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJmaKxRcoRa4vZALEpkF1z_wXVEWra3AuVlT9OKzuHYNip082B8ECvyV1brATkrQ1Z5tXpyjFgR7t-3BanS2pCK0x4aaU_O93uc5zPJh_0CWqafF4v1fliKZzV-a2gjkh6YzDu2coTBVL6vtFT1b3-AouNSDA_txX9w4QfUKr9rJHn0 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:19:24.649012 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestVolumeBootPattern-682269922 Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bf4f0ec8413644aea92cd53c1e54b5d7 Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:19:24.650523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a'} Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:19:24.651472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:19:24.652810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:19:24.655426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Returning 404 to user: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:19:24.657028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6530fe60-c33e-44e7-8102-c0e91b4e47dd tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 404 len: 111 microversion: 2.1 time: 0.050824 Sep 07 13:19:24.666557 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 423/851] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:24 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:24.776355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:24.777816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:24.789986 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.792119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.793070 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.795072 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.796517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.799496 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.824807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084278219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047053971", "security_groups": [{"name": "tempest-secgroup-smoke-483916809"}], "block_device_mapping_v2": [{"uuid": "d50dbddd-8317-4bd3-b102-678078321c4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74553432-837c-413c-8ed6-0393cb35ede1"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:24.988401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.002060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.004401 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.006158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-082965e1-4572-4954-978e-88ded07f51ca tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.234806 Sep 07 13:19:25.026441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 429/852] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:24 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:25.068033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] validate_networks() for [('74553432-837c-413c-8ed6-0393cb35ede1', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:19:25.691220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:19:25.691984 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:19:25.692147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:19:25.692623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:19:25.693091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:19:25.708545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.709420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.710319 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.711742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:25.712783 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:25.713201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.737943 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:19:25.743033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for user bf4f0ec8413644aea92cd53c1e54b5d7 and project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:19:25.819747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:19:25.823017 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d50dbddd-8317-4bd3-b102-678078321c4c',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:19:26.038094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:26.038995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:26.056988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.056988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.059164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.061323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.061822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.065287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.081702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c2d7c47e-b8e8-4f8f-b82b-20b7dda3df80 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.260960 Sep 07 13:19:26.089709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 424/853] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:19:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:19:26.097861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-931c105a-edbe-45d3-bdf0-ccd367b4f3a6 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:26.099164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-931c105a-edbe-45d3-bdf0-ccd367b4f3a6 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:26.229023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-931c105a-edbe-45d3-bdf0-ccd367b4f3a6 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.238169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-931c105a-edbe-45d3-bdf0-ccd367b4f3a6 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1095 microversion: 2.1 time: 0.146791 Sep 07 13:19:26.241267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 425/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:26 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1095 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:26.400921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.412357 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.414576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.415969 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-df711093-bdd7-4fd2-8365-484a969f16e3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.384230 Sep 07 13:19:26.417131 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 430/855] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:26 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:27.273895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:27.276686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:27.292646 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.293560 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.294309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.296171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.297461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.300755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.436902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.441472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-79f53d60-0d79-4ee2-a269-a7b002678a68 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1193 microversion: 2.1 time: 0.178894 Sep 07 13:19:27.449579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:27.455181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:27.466615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 426/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:27 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1193 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:27.489534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.490310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.490942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.491832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.492742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.493486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.752541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.768489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.775077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.779195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-144e4e40-10e8-4c01-a61d-6af32f4fa7e1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.333853 Sep 07 13:19:27.779892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 431/857] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:27 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:28.489554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:28.490156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:28.498126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.498913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.499528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.500399 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.501621 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.502205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.620445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:28.634979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7414a56-d684-491c-bc77-9210d9e895da tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1211 microversion: 2.1 time: 0.146551 Sep 07 13:19:28.635603 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 427/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:28 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:28.808946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:28.810781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:28.819918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.821166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.822488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.823593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.824426 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.825065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.088012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.102642 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.109532 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.112107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-298fdf6b-46c7-4b58-b49d-62b5381d44ab tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.307256 Sep 07 13:19:29.132443 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 432/859] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:28 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:29.661334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:29.662614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:29.674737 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.696207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.699216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.701413 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.703801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.704316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.978346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:29.989488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f5f80075-671b-415a-81d9-c0095e41d7a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.333848 Sep 07 13:19:29.990315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 428/860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:29 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:30.153046 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:30.154211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:30.167754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.168602 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.169609 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.170826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.171542 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.176016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.476429 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.486560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.489107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.490819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3ce93cf5-f382-443e-8e91-87652bd19416 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.345377 Sep 07 13:19:30.506603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 433/861] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:30 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:30.878704 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666a55f8-f232-47ab-a454-82d312d42ea3", "tag": "40e471cd-2b9d-4047-a762-2191e2b9981d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:30.890047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.890861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.893475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.909536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] Creating event network-changed:40e471cd-2b9d-4047-a762-2191e2b9981d for instance 666a55f8-f232-47ab-a454-82d312d42ea3 on hv-cinder-79053 Sep 07 13:19:30.915346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-6cdf2763-568d-4d87-b76a-1440261fe025 req-233da7be-d981-47e9-b2d1-db0aff7fc475 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041335 Sep 07 13:19:30.915944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 429/862] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:31.013385 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:31.014966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:31.026265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.026926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.027614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.028451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.028980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.029474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.237802 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.246104 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-83353627-81bc-4ce8-a72d-813d679fb8ae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.236520 Sep 07 13:19:31.261414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 434/863] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:31 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:31.518546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:31.519679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:31.527425 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.528043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.528929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.529853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.530671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.531283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.707512 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.716349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.717777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.718994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3095c97e-4978-45a5-989b-e4d2f607ecc6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.205427 Sep 07 13:19:31.720255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 430/864] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:31 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:32.269462 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:32.270743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:32.281042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.281551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.282637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.283355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.283809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.284232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.480733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:32.489852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1a9b9acc-fcc9-447d-9df4-2e6fa7ca7ce3 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.224604 Sep 07 13:19:32.490618 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 435/865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:32 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:32.745474 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:32.746365 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:32.754085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.754824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.755338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.756170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.756701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.757203 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.935151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:32.944760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:32.946993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:32.948426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0fd8a87f-bbc1-4acd-bf53-937a8e343341 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.207095 Sep 07 13:19:32.949776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 431/866] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:32 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:33.513687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:33.515176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:33.527923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.528355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.528828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.529546 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.530007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.530456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.799539 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.808205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b387b5ce-bb69-4926-999c-b3a8a5284e33 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.298789 Sep 07 13:19:33.820856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 436/867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:33 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:33.976993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:33.977636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:33.984520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.985018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.986976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.987873 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.988523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.989112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.132313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:34.143905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:34.145631 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:34.146838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ff064235-3cf2-4113-b0fb-68f390acc4b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.173895 Sep 07 13:19:34.147585 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 432/868] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:33 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:34.833785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:34.834235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:34.845909 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.846406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.846869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.847576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.848036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.848459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.112236 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.121430 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6847a353-af81-4f6e-a440-86bf0c047849 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.293749 Sep 07 13:19:35.122659 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 437/869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:34 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:35.173748 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:35.174463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:35.194211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.195018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.195558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.196388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.197035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.197511 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.408105 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.420073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.421528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:35.426725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-39fd484c-5f23-4f4f-9e97-6d40e3a0934f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.254305 Sep 07 13:19:35.430006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 433/870] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:35 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:36.155194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:36.156206 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:36.163351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.163919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.164358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.165077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.168386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.168386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.351321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.361382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7a42e586-663c-46c1-a9c7-8c54bfca504b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.214033 Sep 07 13:19:36.378601 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 438/871] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:36 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:36.457309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:36.458034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:36.460452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:36.461722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:36.468214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.468707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.469149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.470521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:36.471167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:36.471600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.645465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.657157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.659308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.661698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4b93624f-d6a2-40d4-a3ad-efc592782f7a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1739 microversion: 2.20 time: 0.207346 Sep 07 13:19:36.679642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 434/872] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:36 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:37.386033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:37.386780 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:37.393872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.394366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.394850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.395557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.396020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.396460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.552032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.559804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-298405b9-e305-4af6-8c51-0f9cd1f1546e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.177517 Sep 07 13:19:37.575531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 439/873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:37 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:37.690435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:37.691082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:37.697922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.698409 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.698880 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.699581 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.700037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.700466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.850459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.859546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.861286 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:37.862647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3cf75033-6914-4131-9455-de1c7535c025 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1721 microversion: 2.20 time: 0.176669 Sep 07 13:19:37.863291 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 435/874] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:37 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:38.583889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:38.584457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:38.590931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.591416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.591856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.592545 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.593002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.593427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.725825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.733468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a16bacc9-d0fe-4a26-9ab8-8ac63c394019 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.154067 Sep 07 13:19:38.734035 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 440/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:38 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:38.889898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:38.890540 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:38.897642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.898128 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.898614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.899303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.899758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.900185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.029966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.038645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.040093 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.041255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1c0874ee-c398-470c-91e4-933df2afb2ce tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1721 microversion: 2.20 time: 0.155595 Sep 07 13:19:39.041816 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 436/876] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:38 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:39.758890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:39.759448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:39.765721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.766202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.766732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.767427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.767897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.768329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.783975 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=100 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:39.904597 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.912792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b9b12073-1d4d-4989-8f76-296468a71c49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.158014 Sep 07 13:19:39.913356 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 441/877] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:39 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:40.066870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:40.067427 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:40.073866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.074350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.074820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.075509 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.075967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.076393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.205141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.213667 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.215164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.216326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b87a820b-6647-4e2b-9da2-a22a01dd2301 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1721 microversion: 2.20 time: 0.153420 Sep 07 13:19:40.216890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 437/878] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:40 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:40.935441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:40.936057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:40.942962 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.943447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.943894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.944570 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:40.945051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:40.945472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.073905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.082256 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5c9f5b9a-8eee-4bb5-94d4-067f9af2d474 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.150653 Sep 07 13:19:41.082879 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 442/879] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:40 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:41.241878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:41.242524 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:41.249048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.249530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.249970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.250692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.251785 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.252326 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.383714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.391640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.393769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.394981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-32285ee5-c028-4d84-a806-2980b18f1472 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1721 microversion: 2.20 time: 0.157053 Sep 07 13:19:41.395537 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 438/880] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:41 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:42.105114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:42.105704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:42.112709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.113199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.113644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.114407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.114892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.115535 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.256439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.264003 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ee8b8e12-f5eb-4589-8b93-9e04f30e58d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.162840 Sep 07 13:19:42.264562 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 443/881] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:42 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:42.420467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:42.421083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:42.430022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.430554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.430998 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.431702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.432165 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.432594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.563759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.571690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.573107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:42.574244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-202f165d-a8d3-4ca2-96c7-394b5fbd4629 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1721 microversion: 2.20 time: 0.157737 Sep 07 13:19:42.574842 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 439/882] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:42 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:42.710947 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "name": "network-vif-unplugged", "status": "completed", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:42.721608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.722098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.722612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.735017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] Creating event network-vif-unplugged:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:19:42.740475 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-ac10c0e8-884e-4cfe-8fe1-64e8bb94475b req-b5c2d836-09a7-4522-ab69-934262073fc1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033946 Sep 07 13:19:42.741313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 444/883] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:43.285972 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:43.286609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.292544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.293021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.293450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.294126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.294613 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.295040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.426787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.435331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-499a3b5a-d021-4dbf-a96d-d096ab31db29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.153322 Sep 07 13:19:43.435902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 440/884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:43 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:43.600793 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:43.601412 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.603441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=50 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:43.609286 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.609772 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.610212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.611406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.611859 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.612284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.741303 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.749575 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.751053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.752887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-201a7e5f-9d96-4afa-9bad-2b9a1ca943b1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1724 microversion: 2.20 time: 0.157271 Sep 07 13:19:43.753438 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 445/885] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:43 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:43.777104 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab512422-0566-43fd-823d-ac88df8ae275"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:43.779464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:43.786544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.787075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.787520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.788221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:43.788683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:43.789144 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:43.861635 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:44.095507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-85a0820e-fe1d-4c3f-b9d9-f7daca473e2f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321060 Sep 07 13:19:44.095507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 441/886] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Sep 7 13:19:43 2022] POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:19:44.236270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:44.237020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.242994 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.243485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.243922 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.244652 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.245111 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.245537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.289956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120737) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:19:44.360459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-11f16eec-d38b-4566-94f8-302b8a6c4966 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/action" status: 202 len: 0 microversion: 2.20 time: 0.128328 Sep 07 13:19:44.361130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 446/887] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Sep 7 13:19:44 2022] POST /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:19:44.369487 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.370073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.379490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.380170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.381004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.381620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.382238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.382702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.458193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.458981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.466782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.469595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.470092 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.471392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.471862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.472294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.546921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.556586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.558283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.560518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e4e66d50-e77a-4d2d-8cad-82bbe815bd68 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1810 microversion: 2.20 time: 0.194583 Sep 07 13:19:44.561606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 442/888] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:44.623588 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:44.631481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3a0a6bd6-1760-48ee-9448-b4367b6e04a1 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.178218 Sep 07 13:19:44.632055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 447/889] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:45.586135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:45.587014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:45.593908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.594394 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.594865 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.595586 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.596119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.596548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.654534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:45.655158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:45.661247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.661740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.662183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.662907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:45.663368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:45.663800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:45.732052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.742817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.744329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.745508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a80fa912-d065-4773-9ad8-0c6f3d937212 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1810 microversion: 2.20 time: 0.163578 Sep 07 13:19:45.758930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 443/890] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:45 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:45.812287 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.820710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b1b587de-91c9-4c5b-8e14-62b1cbc80786 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.170274 Sep 07 13:19:45.821282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 448/891] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:45 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:46.772085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.773328 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.780084 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.781130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.781665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.783491 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.783906 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.784348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.843635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.844846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.857024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.857785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.858143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.859203 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.859852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.860454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.940766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.949548 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.951051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.952482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1ed9415c-a667-4834-a18c-befdf855eeec tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1752 microversion: 2.20 time: 0.184968 Sep 07 13:19:46.953173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 444/892] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:47.068301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:47.076865 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b69dafb7-ce5e-44b3-8434-eb9812b36bda tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.237304 Sep 07 13:19:47.077674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 449/893] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:47.601780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666a55f8-f232-47ab-a454-82d312d42ea3", "name": "network-vif-plugged", "status": "completed", "tag": "40e471cd-2b9d-4047-a762-2191e2b9981d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:47.608814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:47.615685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.616410 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.617043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.629728 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] Creating event network-vif-plugged:40e471cd-2b9d-4047-a762-2191e2b9981d for instance 666a55f8-f232-47ab-a454-82d312d42ea3 on hv-cinder-79053 Sep 07 13:19:47.635101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-4a018a24-3b09-4907-b44c-c7fc10d9cf9a req-91724d36-ab4f-4266-a110-e25363c256ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Sep 07 13:19:47.635900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 445/894] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:47.985392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:47.986616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:47.993789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.994360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.994924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.995722 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.996255 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.996756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.102573 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:48.103299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:48.109780 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.110478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.111436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.112148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:48.112584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:48.113007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.140646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.150584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.152123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.153523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e2660276-8c6f-4120-a322-8fde98878e75 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.177909 Sep 07 13:19:48.154167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 450/895] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:47 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:48.309562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.320067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2cd83bf2-37d3-4f35-ab04-cb833a3943e2 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.222224 Sep 07 13:19:48.330625 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 446/896] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:48 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:49.179874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:49.180488 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:49.186779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.187263 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.187694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.188467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.188914 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.189664 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.329089 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.340586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.340586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.341569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3cf785fc-8f1a-4cdc-867d-db5761981ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.165611 Sep 07 13:19:49.342251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 451/897] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:49 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:49.346743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:49.347371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:49.355067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.355563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.356186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.358327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.358826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.359253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.501452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.509470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d9d38a61-79d6-4018-be43-a563402c7620 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.167984 Sep 07 13:19:49.510194 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 447/898] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:49 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:50.366894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.370923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.378606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.379301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.379916 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.380625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.381248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.382173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.529570 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.536051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.536867 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.540558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.542032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.543234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-849b1526-d8f9-4383-b28a-2716ee80a1c6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.180173 Sep 07 13:19:50.545087 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.545691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.546185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.547048 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.547589 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.548070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.554183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 452/899] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:51.073319 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.082243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-986a190b-19e5-4a06-8989-c7f4f56ddb49 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.550595 Sep 07 13:19:51.082853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 448/900] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:51.574623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:51.574623 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:51.578570 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.579215 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.579694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.580622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.584362 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.585133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.752768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.763553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.765045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:51.766249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-50881a3e-1089-4858-a62e-56a9849047b6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.200563 Sep 07 13:19:51.766825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 453/901] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:51 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:52.105238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:52.105852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:52.113219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.114023 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.115061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.116121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.116804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.117441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.292584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.301239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9f82122d-0354-4da9-82c4-b7d7264fd8a9 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1266 microversion: 2.1 time: 0.199742 Sep 07 13:19:52.301953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 449/902] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:52 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:52.793128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:52.793768 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:52.801093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.801581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.802017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.802732 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:52.803192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:52.803619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.939494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.949690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.951313 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.952478 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-046e2086-f6ee-4fe9-86d1-b6344a1aaf2d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.163413 Sep 07 13:19:52.953064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 454/903] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:52 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:53.325173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.325784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.332987 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.333463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.333895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.334607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.335310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.335730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.663224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.673083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62229940-d3ff-48e7-aab9-531671324f41 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1454 microversion: 2.1 time: 0.351460 Sep 07 13:19:53.676244 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 450/904] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1454 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:53.702926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.703937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.733363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.734386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.738093 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.741390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.743465 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.746257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.911679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.924987 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-69daec37-762a-468f-8604-e55d21cd4c1b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1454 microversion: 2.1 time: 0.226252 Sep 07 13:19:53.933336 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 455/905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:53.984019 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.985014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.996690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.997200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.999940 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.002294 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.003192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.003635 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.311838 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.341460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.346176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:54.350210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-30cfd9e0-78bc-4f4e-adc3-7323f0500c1a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.374209 Sep 07 13:19:54.350836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 451/906] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:55.377457 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:55.378845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.385896 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.386407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.387094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.387806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.388487 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.388918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.610536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.621940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.624271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.625869 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7aa650d7-dc3c-4533-bc25-a4349575f773 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.253030 Sep 07 13:19:55.628185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 456/907] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:55 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:56.127558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666a55f8-f232-47ab-a454-82d312d42ea3", "tag": "40e471cd-2b9d-4047-a762-2191e2b9981d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:56.139134 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:56.140009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:56.140687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.154609 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] Creating event network-changed:40e471cd-2b9d-4047-a762-2191e2b9981d for instance 666a55f8-f232-47ab-a454-82d312d42ea3 on hv-cinder-79053 Sep 07 13:19:56.160438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-e3b2cc8b-9167-4d1b-9b5b-051e2c75d7a7 req-3103c37e-091f-4c75-8714-e62d9efac62e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037511 Sep 07 13:19:56.161441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 452/908] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:56.653678 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:56.654894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:56.662705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:56.663595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:56.664201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.665077 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:56.665794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:56.666702 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:56.826783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.836612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:56.841261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.843065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:56.844328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-78b2927c-28e1-43c9-a764-b3b91a98c35e tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.194639 Sep 07 13:19:56.854538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 457/909] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:56 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:57.871179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:57.872552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:57.894354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.897097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.897789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:57.899985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:57.902016 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:57.909830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.225151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.235727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.237760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:58.239841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-736e9b3e-8830-4914-876b-d2bae6058ad8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.373915 Sep 07 13:19:58.240411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 453/910] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:57 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:19:59.238398 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:59.239080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:59.248659 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.249155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.249594 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.250306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.250791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.251258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.263514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:59.279964 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.280807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.281502 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.295913 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:19:59.296768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] Creating event network-changed:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:19:59.302386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-1dc788f8-02f2-4497-a43b-71463c0cbc15 req-1db6ba97-84b0-4a83-9298-01f3b9f9d31c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045787 Sep 07 13:19:59.303653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 454/911] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:59.334567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:59.334567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:59.361055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.368121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.368722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.376248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.377039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.378721 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.464158 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-45601f6b-de16-4bb3-86ea-6dcacca8ee24 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 204 len: 0 microversion: 2.1 time: 0.229486 Sep 07 13:19:59.464857 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 458/912] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:19:59 2022] DELETE /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:19:59.484711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:59.485588 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:59.492305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.492819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.493267 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.493989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.494483 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.494923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.591543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:59.602309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:59.605813 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:59.607931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-43f6c4d8-48cc-483d-ad08-149c49870b11 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.302809 Sep 07 13:19:59.609696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 455/913] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:19:59 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:19:59.737392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:59.746004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7f023012-375a-4366-96bc-c70dcd0ff7c5 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.276446 Sep 07 13:19:59.747439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 459/914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:59 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:00.656492 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:00.657515 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:00.667166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.667904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.669409 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.670856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.671663 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.671960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.772653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:00.773455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:00.781452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.782166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.782774 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.783653 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:00.784347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:00.784841 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:00.912982 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.922945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.925499 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:00.927141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-add4e7d8-6e7d-4583-beda-8b5a0717e764 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.296471 Sep 07 13:20:00.928761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 456/915] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:00 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:00.997783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:01.006292 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-564824e1-f58d-479e-90fc-94f6bb75aedd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.238892 Sep 07 13:20:01.023272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 460/916] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:00 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:01.958556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:01.959211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:01.977997 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.978810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.979453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:01.980092 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:01.980736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:01.981093 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.032090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:02.033868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:02.042174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.042980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.043586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.044619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.045431 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.046559 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.225011 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.234528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:02.238116 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.240460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.240621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:02.242085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-734de107-9bc8-41ec-925e-8d5d8d2985df tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.289413 Sep 07 13:20:02.242708 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 457/917] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:01 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:02.262210 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-25f7742c-6832-495d-9a3c-848c2fb281d1 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.229092 Sep 07 13:20:02.267511 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 461/918] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:02 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:03.268833 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:03.269577 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:03.277494 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.277981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.278424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:03.279322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.279811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.280239 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:03.302312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:03.303332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:03.310366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.311213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.311981 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:03.312982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:03.322812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:03.325318 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:03.535891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:03.545968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:03.548668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:03.551197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-09cb7f65-e900-4927-a5ab-93d9a03a0219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.287054 Sep 07 13:20:03.552019 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 458/919] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:03 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:03.620399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:03.629109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1f20cab2-0fc5-4d7e-881b-0c96028d3fd3 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.340517 Sep 07 13:20:03.629679 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 462/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:03 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:04.579211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:04.579801 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:04.588304 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.588776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.589214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.589983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.590534 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.590808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.653072 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:04.654566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:04.661813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.662585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.663030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.663737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.664197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.664626 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.757464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.766665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.768752 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.770309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cea96fc8-38e1-42c2-9823-a66f75e98679 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.195178 Sep 07 13:20:04.771098 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 459/921] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:04 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:04.856327 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:04.871378 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4e908e42-4e6b-4d13-9519-230694c807dd tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.221953 Sep 07 13:20:04.872265 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 463/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:04 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:05.801644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:05.802717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:05.813700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.814436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.815994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.817224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.818028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.818884 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.896892 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:05.897517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:05.904238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.904707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.905141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:05.905842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:05.906311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:05.906739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:06.061554 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:06.071317 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d02ee332-c549-4815-bc51-e5ae8b8511a9 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.179351 Sep 07 13:20:06.072038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 464/923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:05 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:06.271559 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:06.279991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:06.281416 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:06.282661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9e49cf7f-e047-4593-8f6a-a772bc582639 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.486361 Sep 07 13:20:06.283454 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 460/924] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:05 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:07.103601 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:07.104190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:07.111079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:07.111577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:07.112929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:07.113715 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:07.114183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:07.114647 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:07.251074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.263344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-250d785c-b7d3-4bad-9347-5ac1b7a22460 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.163548 Sep 07 13:20:07.264171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 465/925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:07 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:07.308191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:07.308810 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:07.315379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:07.315921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:07.316314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:07.317004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:07.317458 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:07.317955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:07.455544 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.465647 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.467154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:07.468377 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-637289ae-05dc-4875-b207-2ed95a72942d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.164026 Sep 07 13:20:07.468934 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 461/926] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:07 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:08.287557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:08.288180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:08.294819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.295308 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.295749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.296451 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.296995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.297424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.456044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.464183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-27cdeb47-7335-4dc8-a8f9-4cc1f7e33385 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.181037 Sep 07 13:20:08.464845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 466/927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:08 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:08.495465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:08.496742 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:08.504450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.504859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.508110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.508110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:08.508110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:08.508110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:08.819192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.827626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.829356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:08.830569 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-976e9b70-d04c-44aa-97e5-8d57a8486829 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.339674 Sep 07 13:20:08.831870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 462/928] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:08 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:09.488128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:09.488846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:09.497620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.498273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.498984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.500117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.501019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.501709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.848174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:09.866694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:09.866694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:09.875011 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.880078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.880678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.881493 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.882032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.882615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.887806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-397809de-32e9-4450-abe1-0ec4efd07f15 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1564 microversion: 2.1 time: 0.403735 Sep 07 13:20:09.888493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 467/929] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:09 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1564 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:10.089264 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d915e9be-c6af-4ee6-a1cd-f41a4f9b7554", "name": "network-vif-deleted", "tag": "63c8594c-e739-4ceb-8419-f2e47aa90569"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:10.100160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.101563 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.102221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.115143 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] Creating event network-vif-deleted:63c8594c-e739-4ceb-8419-f2e47aa90569 for instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 on hv-cinder-79053 Sep 07 13:20:10.120788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-9653c31a-0d47-4dae-8404-70a8dbbe9ae6 req-94e0cd23-72b7-40f0-b481-21b698ef92a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035510 Sep 07 13:20:10.121951 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 468/930] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:10.146435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.161768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.163323 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.164774 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7c92072-2e66-44a2-b2f5-4d1cee35bcb2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.312530 Sep 07 13:20:10.165396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 463/931] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:09 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:10.914521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:10.915250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.928596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.929551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.930377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.932784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.933687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.937697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.985641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.989139 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.989812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.990742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lazy-loading 'fault' on Instance uuid d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:20:11.042195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2aa1d697a64692bc6a56cb25070c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48aa0016c37430b8666cb2a06a29476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.055080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d407c959-4c55-440c-a19e-264bcb5f9974 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 200 len: 1223 microversion: 2.1 time: 0.144740 Sep 07 13:20:11.056743 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 469/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:10 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:11.191254 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:11.192464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:11.198904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.199385 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.199814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.200929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.201420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.201845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.449196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.460108 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.461973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.463188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-445995ba-9687-4c4c-93f7-56ef7a7ba494 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.276260 Sep 07 13:20:11.463850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 464/933] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:11 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:12.078073 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:12.078712 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] [instance: d915e9be-c6af-4ee6-a1cd-f41a4f9b7554] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:12.085695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.086455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.086895 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.087595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.088049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.088621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.105919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] HTTP exception thrown: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Request method failure captured: Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 HTTP/1.1 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJj8zW5O67RFVB8sc36Bx0U3ER6SfZ48p7N1wl4eqBRDRSr4GdPxgzj5hSJaXwMaMx-OQ9Amdg0qN9u9xC49Qi14dVDuk9APL4eciAPezf373exymCUbKKbRMeoonTy-vpdIkf9tw68M2taZ3WmSsLtIfaN6_Noo1ft5H8PgY8R94Nc Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: a48aa0016c37430b8666cb2a06a29476 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-TestShelveInstance-1222915986 Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:20:12.107681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a48aa0016c37430b8666cb2a06a29476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a48aa0016c37430b8666cb2a06a29476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a48aa0016c37430b8666cb2a06a29476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a48aa0016c37430b8666cb2a06a29476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-TestShelveInstance-1222915986 Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: a48aa0016c37430b8666cb2a06a29476 Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-TestShelveInstance-1222915986 Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-TestShelveInstance-1222915986-project Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: ed2aa1d697a64692bc6a56cb25070c2d Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-TestShelveInstance-1222915986-project Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. Sep 07 13:20:12.109396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'd915e9be-c6af-4ee6-a1cd-f41a4f9b7554'} Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:20:12.110448 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. Sep 07 13:20:12.111891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:20:12.114748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Returning 404 to user: Instance d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:20:12.115874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3d6e5ba1-351a-4b78-af5a-d5972cfa6e01 tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554" status: 404 len: 111 microversion: 2.1 time: 0.041712 Sep 07 13:20:12.116614 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 470/934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:12 2022] GET /compute/v2.1/servers/d915e9be-c6af-4ee6-a1cd-f41a4f9b7554 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:20:12.344022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-61170676-9dd2-4bb4-ae6d-eee5041bd44f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] Calling method '.version_select at 0x7f7f2b591040>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:12.371853 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-61170676-9dd2-4bb4-ae6d-eee5041bd44f tempest-TestShelveInstance-1222915986 tempest-TestShelveInstance-1222915986-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653873450" status: 202 len: 0 microversion: 2.1 time: 0.031653 Sep 07 13:20:12.373783 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 465/935] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Sep 7 13:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653873450 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:20:12.493493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:12.494483 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:12.519251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.520364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.521071 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.524036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.524684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.525891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.793181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.810861 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.812455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:12.813746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d4cc27fe-a222-467c-ba8d-e13a67bb9902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.325212 Sep 07 13:20:12.818593 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 471/936] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:12 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:13.850086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:13.852399 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:13.866083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.866899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.867552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.868462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:13.869088 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:13.872459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.151622 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.173457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.183387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.187913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d9876825-65c5-4d8d-8d7e-79c61f1efe71 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.344116 Sep 07 13:20:14.189061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 466/937] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:13 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:15.220343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:15.220963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:15.224130 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:15.229649 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.230364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.230840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.231547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.232000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.232422 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.470146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.483133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.485030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.486407 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c15c07c2-ad84-46da-afa2-f8e580fcd65b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.270628 Sep 07 13:20:15.496640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 472/938] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:15 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:16.523037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:16.524804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:16.549665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.556001 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.556460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.557190 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:16.557680 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:16.558107 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:16.934914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.970081 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.979293 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:16.981218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7ef1de34-270b-4b63-9c46-548a8fbad6cd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.463880 Sep 07 13:20:16.983195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 467/939] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:16 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:20:18.013731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:18.014673 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:18.030160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.040723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.042033 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.043337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.044031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.045536 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.414248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.423042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:18.438051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.441167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.445119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6b8b128a-1bf0-4e4c-bddd-095f1dff8098 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.435503 Sep 07 13:20:18.446218 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 473/940] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:18 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:19.474322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:19.474966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:19.484086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:19.494676 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.495460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.496097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.496999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.501576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.502407 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.665406 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.685358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.692131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.695452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5d763b82-a9de-4867-adcd-f8e1d7fdaa14 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.227581 Sep 07 13:20:19.697133 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 468/941] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:19 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:20.666680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "name": "network-vif-plugged", "status": "completed", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:20.689388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.690195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.690991 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.708096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] Creating event network-vif-plugged:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:20:20.713934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-374ee45b-94c2-413e-85ca-705dc673a7a7 req-58246164-710e-456a-80fe-ae70a7356bb7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051241 Sep 07 13:20:20.716244 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 474/942] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:20:20.727927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:20.728545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:20.742488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.743079 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.743507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.744245 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.746201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.746685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.041758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.059699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.061787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.074606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e94394b3-d03b-45da-8f3f-fba6ee27fd6a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.350924 Sep 07 13:20:21.090440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 469/943] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:20 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:22.111995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:22.113530 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:22.136504 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.144245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.144904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.146284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.146966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.147561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.450482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.469266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.470826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.472533 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-53b49521-798d-4ea8-9e5b-63e8e0c2f4d8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.370583 Sep 07 13:20:22.477400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 475/944] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:22 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:23.507403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:23.508771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:23.523936 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.524427 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.532912 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:23.533883 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.535397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.536037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:24.135054 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.153250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.154754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:24.156117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6cfd82c0-d540-4be0-870c-c9281de21d6b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1808 microversion: 2.20 time: 0.652540 Sep 07 13:20:24.170223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 470/945] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:23 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1808 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:25.195373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:25.196865 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:25.208813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:25.209500 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:25.210118 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.211064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:25.212920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:25.213576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.433894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.448031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.450024 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.451932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-025b4bfe-784a-4f0b-ac35-6e4d2877bde8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1795 microversion: 2.20 time: 0.267758 Sep 07 13:20:25.461147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 476/946] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:20:25 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1795 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:20:33.425551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7636ffcb-4792-47b4-b68c-445deed1769d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'create', calling method: .version_select at 0x7f7f2b63b0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-422032398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGGtwvNoylC43ga9PpatKCgL7v9iUTscFAMLKZA9cPPJwfBRJHKIA/+3tFzs7b15v/Wp5MpuQQifiHFS5bH6y93vslAhkzKjPU32hWeJwSkgBE+hfvu5F7zFCYdh4uA6w=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:33.443481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-7636ffcb-4792-47b4-b68c-445deed1769d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Getting quotas for project 3c5fb5c46aab43eba5f659ac73062dc7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:33.447827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-7636ffcb-4792-47b4-b68c-445deed1769d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Getting quotas for user 3af213d2cc3140678f1f5ead207797da and project 3c5fb5c46aab43eba5f659ac73062dc7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:33.471605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7636ffcb-4792-47b4-b68c-445deed1769d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049932 Sep 07 13:20:33.472427 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 471/947] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Sep 7 13:20:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:33.575063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-486594568", "imageRef": "dde76162-5518-4d3b-833f-c338e6aa7f46", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-422032398", "networks": [{"uuid": "34833a3c-f4ac-420a-835a-1d4afbebfce0"}]}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:33.632936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] validate_networks() for [('34833a3c-f4ac-420a-835a-1d4afbebfce0', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:20:34.338013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:20:34.338446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:20:34.339177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:20:34.339581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:20:34.339987 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:20:34.350009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.350359 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.350840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.351567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.352025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.352481 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.370018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Getting quotas for project 3c5fb5c46aab43eba5f659ac73062dc7. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:20:34.374021 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Getting quotas for user 3af213d2cc3140678f1f5ead207797da and project 3c5fb5c46aab43eba5f659ac73062dc7. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:20:34.385141 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:20:34.387387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dde76162-5518-4d3b-833f-c338e6aa7f46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:20:34.435520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0fa99a4f-e277-4f46-8699-bde20e08e425 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864058 Sep 07 13:20:34.436345 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 477/948] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:20:34.447979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b5e32a53-3afe-4879-8506-57f522a8965a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:34.448893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b5e32a53-3afe-4879-8506-57f522a8965a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.452219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=73 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:34.510287 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b5e32a53-3afe-4879-8506-57f522a8965a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.517823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b5e32a53-3afe-4879-8506-57f522a8965a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1257 microversion: 2.1 time: 0.074388 Sep 07 13:20:34.518645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 472/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:34 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:35.541906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:35.542474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:35.548924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:35.549408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:35.549929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.550752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:35.551302 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:35.551719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.611633 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.619517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2788052e-1c1e-436e-8546-409eb83969a6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1309 microversion: 2.1 time: 0.081641 Sep 07 13:20:35.620064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 478/950] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:35 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:36.643170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:36.643777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:36.650259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.650778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.651208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.651893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:36.652339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:36.652758 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:36.716496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:36.724682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a36decf5-f445-412a-8095-99becd82b443 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1309 microversion: 2.1 time: 0.085419 Sep 07 13:20:36.725235 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 473/951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:36 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:37.749058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.749688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.756107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.756596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.757034 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.757729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.758182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.758639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.974107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.981707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-afd8b3c7-5b8c-444b-88f7-1fcd1ccb66a3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1309 microversion: 2.1 time: 0.238132 Sep 07 13:20:37.982257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 479/952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:37 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1309 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:39.009034 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.009677 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:39.016521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.017014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.017453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.018153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.018635 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.019472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.588158 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.596976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f765d215-4c3b-4fdd-b344-1961455c2f3b tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.596580 Sep 07 13:20:39.613716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 474/953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:40.249172 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:40.261075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.261977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.262695 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.282602 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] Creating event network-changed:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:20:40.288427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-f970285d-c003-429d-aa76-5a1aa5d370c6 req-e34c6142-cd95-41ef-8a3e-7d1dae7dea37 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043067 Sep 07 13:20:40.289019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 480/954] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:40.622152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:40.622782 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.629811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.630463 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.630986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.631775 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.632364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.632881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.783666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.794086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb9f88b8-97cc-4a44-880f-0ec2a70ae620 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.175564 Sep 07 13:20:40.802787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 475/955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:40 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:41.818978 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:41.819604 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:41.825754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.826247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.826719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.827424 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.827872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.828301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.986236 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.995794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8ea011ba-bd4a-4abd-947d-39ff32951708 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.182310 Sep 07 13:20:41.996382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 481/956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:41 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:43.023804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:43.024421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:43.030870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.031363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.031804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.032496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:43.032955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:43.033383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.207018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.217765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f250f02e-8fe4-4aa0-96df-1ab587fb6b2a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.197923 Sep 07 13:20:43.236561 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 476/957] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:43 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:44.244675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:44.246028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:44.252628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.253201 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.253706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.254561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.255146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.255646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.360123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.381809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.414925 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.430282 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-37498327-6567-47d4-b373-0562b22d10d6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.189263 Sep 07 13:20:44.432213 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 482/958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:44 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:45.455161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:45.455779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:45.460091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:45.465956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.466570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.467083 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.467876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.468395 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.468896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.627252 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.641870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7c1a4a1e-53c5-40b2-a497-d6d7addeb993 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.190454 Sep 07 13:20:45.642572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 477/959] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:45 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:46.666319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:46.666995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:46.668813 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:46.673884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.674375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.675273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.676054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.676548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.677156 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.823767 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.834305 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-298805e9-563a-429c-8fe3-9f30abfa93d3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.172714 Sep 07 13:20:46.835334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 483/960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:46 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:47.857210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:47.857825 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:47.864846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.865699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.866477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.867724 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.868615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.869232 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:48.012778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:48.020971 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b15c4369-d440-4f5f-b7d7-8bb00f7ba643 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.167369 Sep 07 13:20:48.026216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 478/961] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:47 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:49.044309 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:49.044980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:49.051391 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.051877 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.052314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.052995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:49.054020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:49.054464 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:49.183797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:49.192190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-54a1e6c7-0055-44ca-b4ce-a1d4373f3de8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.151727 Sep 07 13:20:49.192748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 484/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:49 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:50.215270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:50.215911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:50.218324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:50.223461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.223939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.224371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.225050 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:50.225541 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:50.226106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:50.360445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:50.369862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-268b9ff3-194f-439e-9d94-c330a3a49737 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.158647 Sep 07 13:20:50.370503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 479/963] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:50 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:51.393054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:51.393672 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:51.400745 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.401238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.401687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.402381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:51.402873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:51.403307 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:51.531778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:51.539724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-06c51c3f-6c26-4a7a-8c11-2b4b398bc2d4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.150600 Sep 07 13:20:51.540291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 485/964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:51 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:52.562214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:52.562809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:52.569243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.569736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.570175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.570897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:52.571360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:52.571795 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:52.701112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:52.708897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c03b432b-6f15-41fc-a606-77bbb95ce66e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.150637 Sep 07 13:20:52.709461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 480/965] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:52 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:53.731477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:53.732076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:53.738565 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.739052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.739490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.740187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:53.740644 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:53.741784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:53.746053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=62 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:54.113442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:54.121173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-27336d9c-df2e-4859-9d5f-40fc875facf6 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.393564 Sep 07 13:20:54.121837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 486/966] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:53 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:55.143805 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:55.144453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:55.150906 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:55.151393 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:55.151833 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:55.152531 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:55.152991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:55.153423 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:55.290405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:55.297937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ae71c25b-e31a-410d-b9eb-fe53e105719a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.158071 Sep 07 13:20:55.298530 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 481/967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:55 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:56.320208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:56.321455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:56.328002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.328485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.328923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.329610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.330065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.330516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.456453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:56.464283 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1926deb0-846e-4562-8f5b-e2f317248b68 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.147826 Sep 07 13:20:56.464851 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 487/968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:56 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:56.790821 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "name": "network-vif-plugged", "status": "completed", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:56.800994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:56.801479 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:56.801911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:56.813455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] Creating event network-vif-plugged:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:20:56.818467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-e47bbd96-3781-40de-b204-5c15c20354f4 req-d2898b78-10b5-4ff0-8500-74f33a9dddc7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Sep 07 13:20:56.819063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 482/969] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:57.487556 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:57.488176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:57.495378 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.495905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.496366 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.497002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:57.497472 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:57.497881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:57.629100 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:57.636676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1300e45e-883a-4e28-b2e7-ee7eb31e899d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.152946 Sep 07 13:20:57.637239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 488/970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:57 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:58.661178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:58.661876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:58.668238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.668729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.669166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.669847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:58.670303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:58.670755 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:58.803882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:58.812015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3afb2990-165f-4180-8405-5cc3552631f7 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1357 microversion: 2.1 time: 0.155570 Sep 07 13:20:58.812578 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 483/971] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:58 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:59.835447 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:59.836205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:59.843770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:59.844268 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:59.844708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:59.845410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:59.845872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:59.846303 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:59.975343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:59.983186 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-54a45308-c9d1-480a-8510-d17fcc6bf5ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1546 microversion: 2.1 time: 0.151681 Sep 07 13:20:59.983781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 489/972] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:59 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:00.006274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.006921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:00.014040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.014566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.015004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.015694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.016153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.017420 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.149841 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.157425 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e22a4114-4f64-4e19-b2e9-702103c387e4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1546 microversion: 2.1 time: 0.154929 Sep 07 13:21:00.157992 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 484/973] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:00.181507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.186274 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.187063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Searching by: {'deleted': False, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7'} {{(pid=120737) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:21:00.193622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.194109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.194598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.195380 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.196332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.196752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.286185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.multi_cell_list [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120737) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:21:00.377822 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-96431092-b378-49ff-a5fc-2e725f072abd tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202420 Sep 07 13:21:00.378325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 490/974] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:00.389946 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:00.390597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:00.396435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.396908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.397346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.398094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:00.398619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:00.399041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:00.535397 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:00.543776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0dcfea22-2820-4913-813a-3bed9f81ca52 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1546 microversion: 2.1 time: 0.157818 Sep 07 13:21:00.545063 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 485/975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:00 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:02.091845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:02.094267 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:02.100971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.101460 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.101903 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.103506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:02.103963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:02.104425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:02.419592 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-28846f56-2b4f-4156-9cb6-4dc9a9630548 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333020 Sep 07 13:21:02.420208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 491/976] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Sep 7 13:21:02 2022] POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:11.110102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:11.110808 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:11.113979 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=13 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:11.114750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=74 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:11.121174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.121658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.122090 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.122815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:11.123270 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:11.123695 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:11.251050 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:11.259184 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1c7c0cac-48ee-460b-bc78-8c20a8878522 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1592 microversion: 2.1 time: 0.152844 Sep 07 13:21:11.259756 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 486/977] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:11 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1592 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:13.023062 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:21:13.023777 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Wed Sep 7 13:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Sep 07 13:21:13.025120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:13.026298 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=17 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:13.027215 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:13.031747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:13.047309 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:13.047931 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:13.048441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:13.065048 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] Creating event network-changed:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:21:13.070428 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-9b8854dd-bf46-43d7-9e22-336ef6b765ba req-6bd37841-b5ff-473f-9cb2-f9bfb1c8c780 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048856 Sep 07 13:21:13.071122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 492/978] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:14.207788 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-368661803"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:14.208324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:14.215563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.216060 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.216499 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.217198 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.217655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.218082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.359391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.network.security_group_api [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Adding security group 79d67447-69b7-4f4f-a074-041e3cd5dceb to port 876a0314-460e-41a9-9037-c75a08aa1c22 Sep 07 13:21:14.686064 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-852893a0-2d23-4574-a83f-f36b9c29248f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action" status: 202 len: 0 microversion: 2.1 time: 0.482043 Sep 07 13:21:14.687168 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 487/979] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:21:14 2022] POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:21:14.696798 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:14.698333 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:14.704762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.705355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.705805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.706558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:14.707037 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:14.707467 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:14.861115 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:14.872226 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-526c7612-d2f7-4ecb-833e-546645051e62 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1756 microversion: 2.1 time: 0.180343 Sep 07 13:21:14.872815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 493/980] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:14 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:15.085942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:15.096003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:15.096563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:15.096993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:15.108446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] Creating event network-changed:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:21:15.113535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b37e543a-4ac2-4f10-b079-be1470ed3264 req-a3dde78d-6817-4260-a39d-279d37ab699f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 Sep 07 13:21:15.114121 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 488/981] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:16.517044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:16.517551 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:16.523830 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.524306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.524739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.525413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.526136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.526604 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.553973 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fa31d35e-a043-40f5-970e-8616b0f3a219 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments/ab512422-0566-43fd-823d-ac88df8ae275" status: 200 len: 194 microversion: 2.20 time: 0.040931 Sep 07 13:21:16.554552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 494/982] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Sep 7 13:21:16 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments/ab512422-0566-43fd-823d-ac88df8ae275 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:21:16.627793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:16.628435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:16.634627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.635118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.635556 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.636259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.636749 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.637178 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.718533 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lazy-loading 'services' on Instance uuid bdbf7c6a-056e-45e0-a43d-682c3c3fda84 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:16.793435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69586718-1117-4952-8f4a-65844feafe26 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments/ab512422-0566-43fd-823d-ac88df8ae275" status: 202 len: 0 microversion: 2.20 time: 0.170220 Sep 07 13:21:16.794015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 489/983] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Sep 7 13:21:16 2022] DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments/ab512422-0566-43fd-823d-ac88df8ae275 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:21:16.803844 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:16.806013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:16.812224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.812721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.813164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.813940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:16.814697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:16.815243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:16.851634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f06a517a-59a4-4001-812b-e2993c8c1f8a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052629 Sep 07 13:21:16.853182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 495/984] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Sep 7 13:21:16 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:21:17.869390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:17.871871 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:17.878114 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.878636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.879072 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:17.879770 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.880225 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.880651 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:17.911445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-19a4d53b-9d1f-423d-8eb3-4c55810b34c4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047573 Sep 07 13:21:17.912085 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 490/985] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Sep 7 13:21:17 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:17.975988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:17.976554 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:17.983784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.984259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.984688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:17.985368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:17.985818 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:17.986239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:18.011028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:21:18.084661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9efe9d37-dd9c-44a1-939c-85dfce216188 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 204 len: 0 microversion: 2.20 time: 0.112231 Sep 07 13:21:18.085517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 496/986] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Sep 7 13:21:17 2022] DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:21:18.095396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:18.095931 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:18.102329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:18.102845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:18.103400 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:18.104096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:18.104550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:18.106207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:18.240893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:18.249148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:18.250635 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:18.251789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d2f7643f-e682-44b7-9e86-045892486f4c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.160853 Sep 07 13:21:18.252351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 491/987] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:18 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:19.277752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:19.278468 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:19.284905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:19.285390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:19.285825 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:19.286550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:19.287009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:19.287439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:19.419222 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:19.427259 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:19.428730 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:19.429908 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-323b08a0-598f-49f2-9577-0e497329fc77 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.156480 Sep 07 13:21:19.430521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 497/988] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:19 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:20.455984 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:20.456605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:20.463126 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:20.463614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:20.464061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:20.464762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:20.465216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:20.465648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:20.612654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:20.620606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:20.622706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:20.623874 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-09b259b4-25ef-490b-95f2-50bd588fdde3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1723 microversion: 2.20 time: 0.171865 Sep 07 13:21:20.624433 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 492/989] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:20 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:21.502665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbf7c6a-056e-45e0-a43d-682c3c3fda84", "name": "network-vif-deleted", "tag": "69c80bf9-e7c3-4ff7-a808-ee58df37d054"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:21.513604 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.514095 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.514619 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.538373 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] Creating event network-vif-deleted:69c80bf9-e7c3-4ff7-a808-ee58df37d054 for instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 on hv-cinder-79053 Sep 07 13:21:21.543125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-3f1d8553-b25c-48a3-b261-9435335bdbed req-440443ec-c7d2-4dba-b1fb-63e60e24cf96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044162 Sep 07 13:21:21.543733 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 498/990] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:21.649364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:21.651065 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:21.658769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.659633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.660301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.661014 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.661503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.661891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.706998 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:21.707767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:21.708210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:21.708837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lazy-loading 'fault' on Instance uuid bdbf7c6a-056e-45e0-a43d-682c3c3fda84 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:21:21.788301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:21.798257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:21.799750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:21.800920 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bfdb155f-097c-4d62-9d57-5787df12b944 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 200 len: 1372 microversion: 2.20 time: 0.155592 Sep 07 13:21:21.801778 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 493/991] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:21 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:21:22.829002 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:22.829704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:22.835893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:22.836377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:22.836816 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:22.837503 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:22.837991 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:22.838441 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:22.852173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 HTTP/1.1 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:21:22.853842 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:21:22.855871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'bdbf7c6a-056e-45e0-a43d-682c3c3fda84'} Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:21:22.857045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:21:22.858919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:21:22.860396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:21:22.860396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f48f52bf-798d-49ac-b0e6-f0d7f23b85eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 404 len: 111 microversion: 2.20 time: 0.031590 Sep 07 13:21:22.860396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 499/992] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:22 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:21:22.864282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-154888b4-b8d8-4be4-ba39-4042a3461508 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '.version_select at 0x7f7f2b5e5dc0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:22.882768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-154888b4-b8d8-4be4-ba39-4042a3461508 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673805328" status: 204 len: 0 microversion: 2.20 time: 0.022327 Sep 07 13:21:22.883330 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 494/993] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Sep 7 13:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673805328 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:21:23.512485 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-df66c6f1-9f18-468c-8746-9be801fb2186 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: .version_select at 0x7f7f2b731940>, body: {"keypair": {"name": "tempest-keypair-1088972234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbshhAP9FreO22am0dVynXTNrbYbE+XMm6vcpKXNrde8XSPDRJXdYMtC2Z9aGqAJb8gaxnSC7EW3plWUZQRZ3UeUEHjW4zdF26ix8GdmIznChMDCvQXBMRzNzEfH4hklw=="}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:23.529923 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-df66c6f1-9f18-468c-8746-9be801fb2186 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for project c32197c49dda403aa8c184ca2c7426ab. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:23.533683 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-df66c6f1-9f18-468c-8746-9be801fb2186 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for user 31e08e973fed47618d748df8defa665b and project c32197c49dda403aa8c184ca2c7426ab. Resources: {'key_pairs'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:23.558517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-df66c6f1-9f18-468c-8746-9be801fb2186 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050456 Sep 07 13:21:23.560595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 500/994] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Sep 7 13:21:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:21:24.900477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1516196045", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc576b82-456a-4c5e-b736-a73bc3dcc5eb"}], "security_groups": [{"name": "tempest-securitygroup--2044673976"}], "key_name": "tempest-keypair-1088972234", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:25.025977 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] validate_networks() for [('cc576b82-456a-4c5e-b736-a73bc3dcc5eb', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:21:25.436856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:21:25.437356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:21:25.437900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:21:25.438382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:21:25.438897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:21:25.448176 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.448727 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.449281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.450854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:25.451382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:25.451894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:25.469179 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for project c32197c49dda403aa8c184ca2c7426ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:25.473097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Getting quotas for user 31e08e973fed47618d748df8defa665b and project c32197c49dda403aa8c184ca2c7426ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:25.490764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:21:25.490764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:21:25.540152 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d36de94b-824e-4d22-aea9-a7b918c542d0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.644770 Sep 07 13:21:25.540809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 495/995] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Sep 7 13:21:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:21:25.553893 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:25.556453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:25.628657 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:25.636230 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:25.638935 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:25.640063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-293a0ad5-f724-4de0-b1e8-e89233383096 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1282 microversion: 2.20 time: 0.091747 Sep 07 13:21:25.640937 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 501/996] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:25 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:26.665112 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:26.665815 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:26.673204 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:26.673688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:26.674120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:26.674854 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:26.675303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:26.675725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:26.765426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:26.773776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:26.775355 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:26.776464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e9252b5f-9e1c-4a4d-afec-dab71c4f0368 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1334 microversion: 2.20 time: 0.115828 Sep 07 13:21:26.777024 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 496/997] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:26 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:27.803232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:27.803855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:27.811613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:27.812245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:27.812687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:27.813543 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:27.814174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:27.814630 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:27.890885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:27.902704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:27.905202 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:27.906646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-76dca382-1877-4f19-bff2-3719756e5be3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1340 microversion: 2.20 time: 0.107449 Sep 07 13:21:27.907579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 502/998] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:27 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:21:28.717046 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:28.727205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.727765 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.728215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.740587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] Creating event network-changed:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:21:28.745373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b89dd068-2238-452c-9771-24702d3e906a req-01a327c9-840a-41ea-858f-54f1e8666754 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Sep 07 13:21:28.745965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 497/999] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:28.934473 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:28.935805 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:28.942974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.943666 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.944289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.944998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.945456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.945974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:29.160006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.169146 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.171901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.172718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ed7d0f4c-95bd-4b81-bee0-4d8716d1cec4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.242990 Sep 07 13:21:29.179178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 503/1000] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:28 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:30.198167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:30.198902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:30.205813 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.206308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.206830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.207535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.207996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.208426 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.342138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.350310 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.351800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.352918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d58445d6-4472-41af-bb81-63e037dfad78 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.159509 Sep 07 13:21:30.353488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 498/1001] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:30 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:31.380779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:31.381516 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:31.389182 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.389684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.390128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.390867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.392155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.392940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.529233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.537370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.538960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.540096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-96b5b5e4-ca12-4544-a209-ffbf893f8120 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.163418 Sep 07 13:21:31.540655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 504/1002] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:31 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:32.565659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:32.566206 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:32.572690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.573173 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.573612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.574298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.574788 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.575697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.702934 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:32.710881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:32.712307 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:32.713402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-369eba11-4c5a-4033-b50b-e81f2002f5c2 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.151698 Sep 07 13:21:32.713955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 499/1003] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:32 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:32.958855 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "name": "network-vif-plugged", "status": "completed", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:32.972050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.973531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.973974 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.989068 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] Creating event network-vif-plugged:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:21:33.003041 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-84315c46-be10-4e6f-a4f5-6c44e919da38 req-a85d5005-7a00-4b9e-8c0a-d6c3de7a5673 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047989 Sep 07 13:21:33.003929 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 505/1004] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:33.738848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:33.739461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:33.748149 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.749419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.749957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.750827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.751258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.751692 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.883450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:33.892243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:33.893693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:33.894837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1de5e792-ae55-4585-a214-2504875474a4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.159991 Sep 07 13:21:33.895396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 500/1005] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:33 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:34.919744 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:34.920453 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:34.927258 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.927751 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.928191 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.928883 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.929344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.929773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.058381 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.067198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.068649 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.069753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-de06566f-f381-4493-b9ca-2258422c3c03 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1408 microversion: 2.20 time: 0.154337 Sep 07 13:21:35.070312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 506/1006] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:34 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:36.099027 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:36.099767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:36.101967 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:36.102660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:36.109402 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.109891 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.110329 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.111052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.111504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.111932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.243170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:36.251344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:36.252796 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:36.253989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-68c52dd0-335e-48bf-8cf7-01fd10bb61e5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1600 microversion: 2.20 time: 0.160805 Sep 07 13:21:36.254575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 501/1007] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:21:36 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:21:36.277984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:36.278583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:36.281380 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:36.287194 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.287704 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.288140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.288820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.289271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.289692 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.365495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-b0dd4c74-1b0e-440f-8990-0853bc49853a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091274 Sep 07 13:21:36.366085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 507/1008] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Sep 7 13:21:36 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:21:37.549784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:37.559743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.560229 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.560747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.572082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] Creating event network-changed:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:21:37.577377 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5caf89e1-765c-4887-b67d-6128292c649c req-c812d4ed-1dc2-4341-aa67-1fa363de6ebf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031241 Sep 07 13:21:37.578487 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 502/1009] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:50.143119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:50.143919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:50.148352 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:50.150622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:50.158899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.159380 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.159810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.160490 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.160970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.161393 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.249231 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d1e0e409-38cd-4413-b008-0876a1d70305 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action" status: 202 len: 0 microversion: 2.1 time: 0.107238 Sep 07 13:21:50.253514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 508/1010] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:21:50 2022] POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:21:50.256922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:50.258657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:50.263228 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:50.263933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:50.272876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.273440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.274039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.275575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.276037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.276625 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.424579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:50.433237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2193487c-01d0-490a-bca9-e4698862165c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1748 microversion: 2.1 time: 0.178072 Sep 07 13:21:50.433872 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 503/1011] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:50 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1748 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:51.460009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:51.460635 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:51.466852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:51.467342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:51.467782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.468965 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:51.469426 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:51.469858 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.617641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:51.625808 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-8ab4c64d-935a-4896-81e1-4d79ca2850a8 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.170669 Sep 07 13:21:51.626382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 509/1012] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:51 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:52.649375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:52.649995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:52.656880 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.657366 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.657800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.658584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.659041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.659467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.798919 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:52.807022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7aa1a136-94c6-4695-99ca-f95069296530 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.161492 Sep 07 13:21:52.807595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 504/1013] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:52 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:53.830137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:53.830853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:53.837342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.837829 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.838267 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.838991 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.839445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.839871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.980523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:53.988682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7a1c7d69-e629-4b04-bd54-9c98b8530ac4 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.163146 Sep 07 13:21:53.989252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 510/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:53 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:55.012018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:55.012629 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:55.019446 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.019924 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.020355 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:55.021033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.021481 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.021901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:55.164430 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:55.173347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b63d981c-67c6-4c2f-bcbf-386252f33ca3 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.165247 Sep 07 13:21:55.173928 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 505/1015] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:55 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:56.196412 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:56.197082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:56.204432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:56.204928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:56.205375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.206094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:56.206641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:56.207075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.347386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:56.355480 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4ae880df-9dd2-43ee-97c7-3960bbf42118 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.162941 Sep 07 13:21:56.356053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 511/1016] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:56 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:57.379015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:57.379694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:57.386207 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:57.386726 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:57.387171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:57.387864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:57.388391 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:57.388819 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:57.529734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:57.538003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-16aaa0ef-94a5-4f9d-b3cd-eda2e872e575 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.162843 Sep 07 13:21:57.538600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 506/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:57 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:58.562315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:58.563120 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:58.570105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:58.570970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:58.571402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:58.572193 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:58.572728 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:58.573164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:58.722698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:58.731075 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f68a7a45-6446-4925-b855-fe0583bca44d tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.173012 Sep 07 13:21:58.731639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 512/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:58 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:59.757694 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:59.758315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:59.764890 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:59.765379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:59.766624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:59.767336 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:59.767803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:59.768231 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:59.910905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:59.919073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5931fca0-6399-46f8-86b6-5013e7745ef9 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.167084 Sep 07 13:21:59.919644 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 507/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:59 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:00.942690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:00.943365 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:00.950239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.950776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.951219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:00.951924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.952382 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.952809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.095427 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:01.103494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bd9cee1e-3019-420f-90da-f4e50d939078 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.164701 Sep 07 13:22:01.104054 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 513/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:00 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:02.127442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:02.128061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:02.134650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:02.135563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:02.135563 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:02.136250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:02.136776 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:02.137180 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:02.280570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:02.288835 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e5184df1-d8a1-45fd-908b-08b9518534ea tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.165762 Sep 07 13:22:02.289440 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 508/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:02 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:03.311884 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:03.312436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:03.319779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.320266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.320705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.321392 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.321845 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.322272 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.467116 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:03.476051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6959e8e0-3022-4605-989d-ca8084bf3c84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.168134 Sep 07 13:22:03.476616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 514/1022] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:03 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:04.499648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:04.500264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:04.507234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.507713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.508143 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.508826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.509280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.509701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.663078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:04.671253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7fe1afb4-811c-457d-9c58-bc888dc46a21 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.175562 Sep 07 13:22:04.671837 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 509/1023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:04 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:05.313379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1097302236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047053971", "security_groups": [{"name": "tempest-secgroup-smoke-483916809"}], "block_device_mapping_v2": [{"uuid": "c68a51e9-a60f-48a3-9369-914e71437686", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74553432-837c-413c-8ed6-0393cb35ede1"}]}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:05.427687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] validate_networks() for [('74553432-837c-413c-8ed6-0393cb35ede1', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:22:05.695991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:05.696981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:05.702745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.703233 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.703666 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.704363 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.704813 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.705234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.813764 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:22:05.814217 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:22:05.814741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:22:05.815702 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:22:05.816110 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:22:05.824637 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.825105 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.825541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.826261 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.826742 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.827167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.844364 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:05.848525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Getting quotas for user bf4f0ec8413644aea92cd53c1e54b5d7 and project e272b3e5ef9244098642eef1a8c4be51. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:05.851334 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:05.859638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2cfa61d8-51bb-4096-ac77-68745beefa78 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.168055 Sep 07 13:22:05.860208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 510/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:05 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:05.906502 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:22:05.908606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c68a51e9-a60f-48a3-9369-914e71437686',volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:22:06.041856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0e6a5ecf-a049-4d72-ba39-e04778f48fd0 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732222 Sep 07 13:22:06.042507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 515/1025] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:22:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:22:06.053490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e1c6fe30-7db7-43d5-9001-a84e538a58bc tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:06.054106 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e1c6fe30-7db7-43d5-9001-a84e538a58bc tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:06.108140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e1c6fe30-7db7-43d5-9001-a84e538a58bc tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:06.116381 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e1c6fe30-7db7-43d5-9001-a84e538a58bc tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1095 microversion: 2.1 time: 0.066772 Sep 07 13:22:06.116974 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 511/1026] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:06 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:06.883337 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:06.884080 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:06.891531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.892546 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.893006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.894493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.894963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.895399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.041699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:07.050242 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d8968b8c-5160-4bad-ac31-d4d46eadc4d0 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1753 microversion: 2.1 time: 0.171568 Sep 07 13:22:07.050853 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 516/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:06 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:07.139305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:07.139893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:07.147263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:07.147746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:07.148180 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.148866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:07.149322 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:07.149744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.210177 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:07.217941 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d1d90108-91e1-4754-98db-9c31394bcb29 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1193 microversion: 2.1 time: 0.082506 Sep 07 13:22:07.218535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 512/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:07 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:08.073029 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:08.073759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:08.080736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.081351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.081799 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.082518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.082995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.083405 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.241961 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:08.242619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:08.249044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.249803 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.250494 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.251398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.252080 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.253073 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.320903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:08.328643 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69d6a6c6-1fca-4e85-8b06-45ced44770df tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1211 microversion: 2.1 time: 0.091400 Sep 07 13:22:08.329218 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 513/1029] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:08 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:08.342636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:08.342636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c5b1ba5e-e3d2-47a5-b56e-ebc9687fea8a tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1756 microversion: 2.1 time: 0.271341 Sep 07 13:22:08.342636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 517/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:08 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1756 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:09.353379 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:09.354028 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:09.361113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.361605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.362047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.362965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.363432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.363865 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.496382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:09.504371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7faaf2f3-da66-49fb-bdc4-1845ad6c491c tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.154926 Sep 07 13:22:09.504945 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 514/1031] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:09 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:09.971125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4596378e-5af7-4b9c-b6b6-d69421c2d5ae", "tag": "2ffb3b1e-7447-4a3b-beb1-3b555cf203cc"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:09.981377 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.981863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.982300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.994650 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] Creating event network-changed:2ffb3b1e-7447-4a3b-beb1-3b555cf203cc for instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae on hv-cinder-79053 Sep 07 13:22:09.999420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-e8f4f70b-048b-4166-b135-e4d4033d700a req-557490db-0e09-481b-96ed-6e61bf5e7082 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164253 Sep 07 13:22:10.000012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 518/1032] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:10.527138 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:10.527763 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:10.534812 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.535201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.535645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.536335 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.536832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.537264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.673496 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:10.682353 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-67437aa9-c47e-42c3-9251-e725831da2e8 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.159077 Sep 07 13:22:10.682976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 515/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:10 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:11.706902 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:11.707620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:11.713724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.714211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.714674 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.715363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.715819 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.716248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.847681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:11.855280 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e9e41f68-35fc-4306-82c3-a55226e6e83d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.153879 Sep 07 13:22:11.855834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 519/1034] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:11 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:12.878295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:12.879043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:12.885362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.885845 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.886283 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.887002 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.887462 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.887887 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.014898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:13.023150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f3588ca5-f251-4074-8982-e38c5bb83576 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.148797 Sep 07 13:22:13.023725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 516/1035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:12 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.047632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.048247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.055521 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.056010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.056445 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.057136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.057595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.058053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.191513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:14.199239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ab99f3dd-1181-4361-91fc-300e7503aced tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.155561 Sep 07 13:22:14.199806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 520/1036] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:14 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:15.222696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:15.223386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:15.229580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.230053 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.230508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.231188 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.231635 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.232056 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.360208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:15.367930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7569cb5e-a7ec-4a4f-8d46-43b0432e0aae tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.150097 Sep 07 13:22:15.368501 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 517/1037] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:15 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:16.391925 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.392529 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:16.395200 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:16.395852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:16.401727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.402196 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.402665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.403351 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.403801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.404220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.540930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.549082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0e392fca-5007-40ac-a4c6-df4e72a3a085 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.161185 Sep 07 13:22:16.549707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 521/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:17.573350 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.574000 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.576131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:17.582506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.583074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.583545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.584949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.585428 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.585857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.726205 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:17.734193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e4cb645b-2833-4e72-9997-b1f642b95693 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.165427 Sep 07 13:22:17.734784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 518/1039] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:18.760116 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.760746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.767122 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.767606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.768040 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.768723 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.769172 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.769591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.900517 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.908154 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e49a4ec8-8af7-46ae-b91b-4a9bf24df78f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.153383 Sep 07 13:22:18.908717 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 522/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:19.930978 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:19.931629 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:19.939076 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.939621 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.940167 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.940990 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.941456 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.941913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.076485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:20.096086 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-727ccf13-ad1c-4a5e-8fb7-50a37c68051d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.158716 Sep 07 13:22:20.096786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 519/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:19 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:21.121128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:21.121847 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:21.125022 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:21.128901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.129394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.129836 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.130578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.131084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.131558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.135214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:21.293420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:21.301390 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2b959592-4017-4276-b547-ae8636bbc52b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.185450 Sep 07 13:22:21.301972 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 523/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:21 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:21.322510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4596378e-5af7-4b9c-b6b6-d69421c2d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "2ffb3b1e-7447-4a3b-beb1-3b555cf203cc"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:21.327315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=37 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:21.332730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.333209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.333637 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.338183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:21.346632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] Creating event network-vif-plugged:2ffb3b1e-7447-4a3b-beb1-3b555cf203cc for instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae on hv-cinder-79053 Sep 07 13:22:21.352208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b1126306-f8ea-408d-bd08-05baeea3d782 req-440ec8a8-92b1-4f34-af75-240231014c5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114615 Sep 07 13:22:21.352790 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 520/1043] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:21.979494 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:21.979880 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:21.985806 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.986298 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.986771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.987470 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:21.987930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:21.988409 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.013157 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-dfb3ce21-8319-4c62-9b66-d41eb85531d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/ips" status: 200 len: 151 microversion: 2.20 time: 0.037780 Sep 07 13:22:22.013718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 524/1044] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Sep 7 13:22:21 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:22:22.325528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:22.326225 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:22.332264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.332743 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.333183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.333860 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.335008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.335438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.471039 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:22.479642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-98e04307-5761-49d3-80d8-c2f0d946052f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.158699 Sep 07 13:22:22.480221 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 521/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:22 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:23.503927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:23.504465 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:23.511142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:23.511638 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:23.512082 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:23.512781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:23.513243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:23.513678 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:23.645794 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:23.654534 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-afab012a-6be1-4c79-a4f4-9d2354dc419e tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1454 microversion: 2.1 time: 0.154500 Sep 07 13:22:23.655197 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 525/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:23 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:23.677351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:23.678723 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:23.685976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:23.686490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:23.687140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:23.687843 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:23.688302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:23.688734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:23.824037 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:23.831806 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a358e70f-0571-4059-b90e-8b85d642890f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1454 microversion: 2.1 time: 0.158478 Sep 07 13:22:23.832374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 522/1047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:23 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:24.205235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:24.205866 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:24.212504 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.213241 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.213680 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.214375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.214854 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.215281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.243235 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lazy-loading 'flavor' on Instance uuid 22fcfa63-f894-4105-b24f-ba1a9afc6db3 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:24.438837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-656316d6-ac84-4422-b359-959f3ad9a08d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/action" status: 202 len: 0 microversion: 2.20 time: 0.237239 Sep 07 13:22:24.439425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 526/1048] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Sep 7 13:22:24 2022] POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:24.448211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:24.449067 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:24.455934 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.456740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.457191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.458078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.458633 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.459102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.719552 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:24.728482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:24.729918 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:24.731118 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5187ae55-7f98-45b5-a1f8-270bdc596a81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.287507 Sep 07 13:22:24.731683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 523/1049] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:24 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:25.735621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4596378e-5af7-4b9c-b6b6-d69421c2d5ae", "tag": "2ffb3b1e-7447-4a3b-beb1-3b555cf203cc"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:25.746595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.747078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.747506 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.757551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:25.758751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:25.760838 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] Creating event network-changed:2ffb3b1e-7447-4a3b-beb1-3b555cf203cc for instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae on hv-cinder-79053 Sep 07 13:22:25.764893 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.765378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.765811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.766114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-97072df8-13a9-49d8-826e-ce1ce1cc45eb req-201ee9ea-4f44-4005-96a8-5472d56b4ebe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087884 Sep 07 13:22:25.766669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.767123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 527/1050] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:25.767269 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.767606 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.909044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:25.918013 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:25.919645 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:25.920944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ba3f1f9c-cad9-493b-8fb8-ba9099994e79 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.167846 Sep 07 13:22:25.921797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 524/1051] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:25 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:26.949471 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:26.951039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:26.957699 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.958341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.958812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.959834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.960634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.961425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.118315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.128675 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.130169 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.131359 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4a1ed57e-29ba-4046-9775-e8bdbbcab44d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.187722 Sep 07 13:22:27.131928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 528/1052] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:26 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:28.159746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:28.160361 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:28.167057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.167539 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.167976 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.168668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.169124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.169545 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.302740 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:28.311038 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:28.312467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:28.313612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4cf228f0-e429-494e-a3c1-2931690feab6 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.157849 Sep 07 13:22:28.314169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 525/1053] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:28 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:29.338442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:29.339055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:29.345942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.346459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.346905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.347628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.348125 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.348553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.479738 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:29.487728 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:29.489163 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:29.490319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-853fe864-76b3-4bc4-8d9a-4a5e7899292b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.156341 Sep 07 13:22:29.490904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 529/1054] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:29 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:30.515309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:30.515926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:30.523195 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.523670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.524113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.524804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.525276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.525707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.655934 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.665225 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.667360 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:30.668696 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-870cabd2-67a2-4b3b-9107-13e4a8f48f96 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.157187 Sep 07 13:22:30.669273 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 526/1055] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:30 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:31.693914 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:31.694613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:31.701145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.701630 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.702064 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.702795 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:31.703250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:31.703677 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.836569 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.844523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.846214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.847411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-36a0a8a8-e139-42cd-ba18-622cae775b3b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.157477 Sep 07 13:22:31.847966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 530/1056] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:31 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:32.873441 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:32.874084 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:32.880709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.881202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.881774 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.882699 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.883164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.883594 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:33.029520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:33.037571 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:33.039759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:33.040922 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-33c9f13c-334e-4539-a506-ec0ce673b9ff tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.171414 Sep 07 13:22:33.041485 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 527/1057] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:32 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:34.065477 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:34.066127 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:34.073229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:34.073714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:34.074151 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:34.074871 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:34.075325 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:34.075783 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:34.203136 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:34.212164 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:34.213613 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:34.214883 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-047ab61a-d75e-4457-87cd-39fc3c9e424f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.153388 Sep 07 13:22:34.215442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 531/1058] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:34 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:35.240902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:35.242071 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:35.248870 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:35.249343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:35.249786 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:35.250605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:35.251053 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:35.251476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:35.388386 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:35.396478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:35.397932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:35.399220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6f40eca1-c7f2-48c1-9ca4-8b5da9d8c2c7 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.162439 Sep 07 13:22:35.399792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 528/1059] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:35 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:36.425176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:36.425803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:36.432466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.432964 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.433411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:36.434113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.434624 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.435579 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:36.566852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:36.575420 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:36.576751 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:36.577891 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-da938ff8-3355-495d-bb9c-8d563bc3aa9b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.157547 Sep 07 13:22:36.578455 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 532/1060] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:36 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:37.604372 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:37.604910 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:37.611779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:37.612266 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:37.612698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:37.613388 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:37.613836 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:37.614255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:37.747612 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:37.756377 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:37.758501 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:37.759847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-25cc84a0-afcc-45b9-a938-bd90e5f44ee8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.160189 Sep 07 13:22:37.760452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 529/1061] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:37 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:38.785334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.785864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.793501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.793984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.794433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.795135 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.795589 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.796016 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.922531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:38.931418 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:38.932857 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:38.934038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-99600af0-553f-4f67-b6cd-f195fc95299c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.152913 Sep 07 13:22:38.934627 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 533/1062] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:38 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:39.958771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:39.959324 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:39.965985 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.966500 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.966943 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:39.967632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.968091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.968519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.105383 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:40.113367 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:40.114876 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:40.116033 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f6695416-e5e3-4261-896a-a3bffa90e573 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.161317 Sep 07 13:22:40.116596 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 530/1063] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:39 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:41.141074 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:41.141681 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:41.148212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.148700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.149142 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.149834 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.150294 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.150759 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.281643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.290433 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.291915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.293060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-620a1574-6fdc-40e1-a33f-0acae1b82b81 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1745 microversion: 2.20 time: 0.155915 Sep 07 13:22:41.293616 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 534/1064] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:41 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:42.319307 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:42.319917 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:42.327522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.328015 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.328460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.329172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.329611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.330036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.467151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.476174 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.477669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:42.478859 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3e61f230-8c33-4181-a4d4-4815790d054c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1745 microversion: 2.20 time: 0.163512 Sep 07 13:22:42.479414 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 531/1065] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:42 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:43.506656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:43.508705 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:43.516222 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.516960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.517576 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.518513 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.519145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.519573 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.671754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.684787 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.686684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.688085 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e44eb55a-e608-4193-bcc6-ff7b0113cc89 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.187794 Sep 07 13:22:43.702621 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 535/1066] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:43 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:44.715185 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:44.716868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:44.723970 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.724654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.725091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.725807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.726449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.727656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.869153 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.879070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.881751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.883455 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-446ebc6e-c8c9-420c-a754-5f6f363e64e4 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.172063 Sep 07 13:22:44.884110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 532/1067] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:44 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:45.400736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "name": "network-vif-plugged", "status": "completed", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:45.421760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.423856 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.424515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.445039 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] Creating event network-vif-plugged:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:22:45.451090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-65cb1f73-82c8-47c5-ac7c-d9d692be4e76 req-9eab2c7b-e004-466d-8241-41efa7839f86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055128 Sep 07 13:22:45.452482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 536/1068] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:45.911091 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:45.911730 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:45.919341 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.919847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.920291 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.921008 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.921472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.921904 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:46.084983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:46.096125 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:46.098003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:46.099543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a23b9e29-c2e8-44ec-87d0-2fe1feb0ec45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.192430 Sep 07 13:22:46.100113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 533/1069] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:45 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:47.126491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:47.128030 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:47.138129 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:47.138985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:47.139676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:47.140631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:47.141312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:47.141811 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:47.297200 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:47.306631 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:47.308060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:47.309212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-380f6386-4c7f-4137-a837-b0a217ca58aa tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.187613 Sep 07 13:22:47.322518 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 537/1070] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:47 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:48.478996 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:48.479773 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:48.486673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:48.487055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:48.487489 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:48.488192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:48.488641 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:48.489058 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:48.636981 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:48.645929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:48.647422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:48.648820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6ffe43da-0e41-42f6-ac14-8c5f83fe212a tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.315453 Sep 07 13:22:48.649960 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 534/1071] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:48 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:49.674507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:49.675117 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:49.685785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.686250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.687009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.687956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.688632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.689278 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.845113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.853984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.855423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.856574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-295c662b-1ddc-47d2-9d34-e934e3bb117c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.186017 Sep 07 13:22:49.857347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 538/1072] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:49 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:50.882587 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:50.884777 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:50.891466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.892170 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.892719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:50.893648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.894183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.894722 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:51.036452 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.046551 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.047995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.049250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aa673a02-595c-4bec-a041-a5824e5264f5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.170643 Sep 07 13:22:51.049826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 535/1073] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:50 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:51.531520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-368661803"}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:51.532091 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:51.534753 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=32 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:51.541102 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:51.541608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:51.542060 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:51.542851 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:51.543312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:51.543750 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:51.546998 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:51.703810 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.network.security_group_api [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Removing security group 79d67447-69b7-4f4f-a074-041e3cd5dceb from port 876a0314-460e-41a9-9037-c75a08aa1c22 Sep 07 13:22:52.079074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:52.080442 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:52.087384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a50263ab-529b-4a97-8e73-8049de6b06fe tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action" status: 202 len: 0 microversion: 2.1 time: 0.559224 Sep 07 13:22:52.090384 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=32 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:52.092809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.096113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.097821 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.098932 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.099624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.100340 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.100474 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 539/1074] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Sep 7 13:22:51 2022] POST /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:52.112797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:52.127824 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=92 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:52.146250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.152388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.152826 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.167342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] Creating event network-changed:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:22:52.175161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-ab7b67b8-4945-4fee-a05f-321b0169ef5b req-15551af7-fdd9-4b3f-9dbb-0f85e20b2369 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073358 Sep 07 13:22:52.175773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 540/1075] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:52.348608 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.392290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.418668 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.422935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd44e537-19c5-480a-a5f2-1aa922c64d95 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1740 microversion: 2.20 time: 0.346709 Sep 07 13:22:52.445353 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 536/1076] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:52 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:53.367490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:53.377771 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:53.378361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.385772 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.385996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.386396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.386858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.386989 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.387560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.387729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.388017 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.388508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.399275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] Creating event network-changed:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:22:53.404855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-975c683a-db85-437e-8f98-5e87fe41999c req-b68515b4-8b13-4535-b641-c9b456987603 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040998 Sep 07 13:22:53.405649 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 537/1077] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:53.452579 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:53.453370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.460171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.460746 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.461255 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.462817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.463389 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.463898 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.481863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lazy-loading 'services' on Instance uuid 0014671f-25b5-4090-9166-08ff6142a43d {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:53.589260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-114ef92f-97ab-46f7-9e4c-b577c57f55ec tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments/6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3" status: 202 len: 0 microversion: 2.1 time: 0.228640 Sep 07 13:22:53.591063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 541/1078] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:22:53 2022] DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments/6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:53.614600 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:53.618291 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.626252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.627712 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.628190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.628932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.629394 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.629817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.670020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-559dc9d9-2c6a-46b6-be69-5c188833aaef tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066249 Sep 07 13:22:53.672415 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 542/1079] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:22:53 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:53.723249 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.737005 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.740567 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.747856 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8d500b3b-fc9c-4e59-8fb4-04b6bfd3e60d tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1722 microversion: 2.20 time: 0.298301 Sep 07 13:22:53.750248 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 538/1080] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:53 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:54.684323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:54.686568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:54.693137 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.693618 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.694050 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.694769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.695224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.695647 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.729126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-54dc2e41-95b1-4d31-bc18-fc7761cdb45e tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Sep 07 13:22:54.729726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 543/1081] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:22:54 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:54.779639 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:54.780247 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:54.786166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.786688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.787130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.787817 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.788276 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.788701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.916761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.924889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.926339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.927535 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7822fc34-0a8d-4ca9-8370-8b581a1c04e9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1722 microversion: 2.20 time: 0.152530 Sep 07 13:22:54.934568 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 539/1082] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:54 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:55.741347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:55.744316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:55.750718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.751199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.751630 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:55.752310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.752761 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.753179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:55.783899 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0146ff54-a12f-4dad-b9f8-83c94255734c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Sep 07 13:22:55.784442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 544/1083] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:22:55 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:55.952382 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:55.953004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:55.960135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.960650 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.961072 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:55.961767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:55.962229 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:55.962697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.096903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.105687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.107159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.108313 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6df28166-69c4-4954-9709-b5c9921cc9fd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1722 microversion: 2.20 time: 0.159851 Sep 07 13:22:56.108872 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 540/1084] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:55 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:56.796314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:56.798661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:56.805167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.805757 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.806228 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.807031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.807591 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.808023 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.837943 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-17e1fa89-7212-4c88-bbc0-c3b57446fd5f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045408 Sep 07 13:22:56.838520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 545/1085] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Sep 7 13:22:56 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:22:56.849747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:56.850331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:56.856624 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.857110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.857547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.858240 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.858735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.859161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.939246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] HTTP exception thrown: Instance 0014671f-25b5-4090-9166-08ff6142a43d is not attached to volume 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Request method failure captured: Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments/6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 HTTP/1.1 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJqO36YgqIDgx_A702pIGjHkTqn6k2guJ0vOov1AyULa3xQ-FwBNW1q4Un0EJUoxVcO7AQCJuLh6mrppKT5mwibv5pCmjVXloWFfiLDXAUqw20tkIR2aTFWsrT679-Hf0HRWrUEtFdyvtaeews7HQw0ZiyAIVSd5Y9PrOikA4PHaGXQ Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 3c5fb5c46aab43eba5f659ac73062dc7 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:22:56.941710 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 3c5fb5c46aab43eba5f659ac73062dc7 Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-TestMinimumBasicScenario-578254724-project Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 3af213d2cc3140678f1f5ead207797da Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestMinimumBasicScenario-578254724-project Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:22:56.943450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 0014671f-25b5-4090-9166-08ff6142a43d is not attached to volume 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'server_id': '0014671f-25b5-4090-9166-08ff6142a43d', 'id': '6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3'} Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3. Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:56.944405 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0014671f-25b5-4090-9166-08ff6142a43d is not attached to volume 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0014671f-25b5-4090-9166-08ff6142a43d is not attached to volume 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:22:56.946764 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Returning 404 to user: Instance 0014671f-25b5-4090-9166-08ff6142a43d is not attached to volume 6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:56.948131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f7a58503-ee9c-4a59-a6be-031e4dbe9edf tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments/6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3" status: 404 len: 154 microversion: 2.1 time: 0.098091 Sep 07 13:22:56.948131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 541/1086] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Sep 7 13:22:56 2022] DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d/os-volume_attachments/6a2b9edf-5f78-4c9b-ba5a-6c1640386fd3 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:57.133546 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:57.134376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:57.140423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.141519 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.141963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.142688 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.143153 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.143583 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.287397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.296752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.298369 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:57.299846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a2ede54d-079c-4f04-bf90-385dc28566a8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1725 microversion: 2.20 time: 0.170258 Sep 07 13:22:57.300497 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 546/1087] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:57 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:57.325166 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a347a257-52a8-429a-99dd-df7ca33abb86"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:57.328074 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:57.336553 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.337760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.338212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.339151 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.339789 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.340490 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.346007 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "name": "network-vif-unplugged", "status": "completed", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:57.357926 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.358432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.359063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.373340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.compute.server_external_events [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] Unable to find a host for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3. Dropping event network-vif-unplugged {{(pid=120737) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 13:22:57.374399 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-7c6436a5-6b1a-40c9-bfd3-7900a79c0ab5 req-c82c39ae-33cf-4942-a2b3-64677b28a964 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034266 Sep 07 13:22:57.375239 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 547/1088] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 13:22:57.610320 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7d70f30e-5d8a-4933-9a09-ac1bcc6cc373 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289404 Sep 07 13:22:57.610942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 542/1089] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Sep 7 13:22:57 2022] POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:22:57.735456 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:57.735957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:57.741901 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.742387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.742996 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.744170 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.744625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.745049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.993918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f614cb75-a72f-43b2-9923-3612ea198b45 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments/a347a257-52a8-429a-99dd-df7ca33abb86" status: 202 len: 0 microversion: 2.20 time: 0.262269 Sep 07 13:22:57.994596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 548/1090] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Sep 7 13:22:57 2022] DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments/a347a257-52a8-429a-99dd-df7ca33abb86 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:58.055691 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:58.056169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:58.062333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.062863 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.063308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.064011 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.064477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.064905 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.085045 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:58.085550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:58.092112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.092603 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.093043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.093739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.094198 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.094656 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.096163 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120738) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 13:22:58.120966 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:22:58.164729 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6ee48828-ba48-4920-adb5-f903483a7742 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/action" status: 202 len: 0 microversion: 2.20 time: 0.113254 Sep 07 13:22:58.165813 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 543/1091] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Sep 7 13:22:58 2022] POST /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:58.173717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:58.174450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:58.182282 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.182657 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.183094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.183800 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.184263 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.184820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.205332 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4803af92-9bef-4e6c-9d6d-490bf19b932f tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 204 len: 0 microversion: 2.1 time: 0.123655 Sep 07 13:22:58.206358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 549/1092] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:22:58 2022] DELETE /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:22:58.218161 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:58.218934 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:58.227840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.228344 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.228837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.229897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:58.230360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:58.230864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:58.361820 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.373862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.375339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.376179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:58.376670 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-57e10dd4-ce56-4859-8934-25911e4538d3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1673 microversion: 2.20 time: 0.206718 Sep 07 13:22:58.377227 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 544/1093] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:58 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:22:58.397446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3ff3a9bc-04a5-4404-af9f-9dcb5c345b84 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1552 microversion: 2.1 time: 0.186094 Sep 07 13:22:58.398043 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 550/1094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:58 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:59.403582 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:59.404193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:59.410655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.411140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.411580 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.412264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.412719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.413140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.421148 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:59.421881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:59.428273 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.428762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.429205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.429898 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:59.430355 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:59.430950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:59.544021 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.552570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.553999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.555216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-04e86153-fbe5-40f9-9139-2358cf82142f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1673 microversion: 2.20 time: 0.156193 Sep 07 13:22:59.555847 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 545/1095] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:22:59 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:22:59.563270 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:59.571375 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5222e89e-ae78-40b1-9a03-1a169d50c6ab tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1552 microversion: 2.1 time: 0.154044 Sep 07 13:22:59.572089 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 551/1096] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:59 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:00.581503 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:00.582226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:00.591147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.591673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.592113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.592823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.593281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.593707 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.598993 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:00.600166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:00.609181 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.609930 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.610610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.611628 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:00.612250 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:00.612868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:00.633406 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:00.770134 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.780271 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6c9a4a2e-af1f-42c3-a97f-14f8e15d0602 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1552 microversion: 2.1 time: 0.189768 Sep 07 13:23:00.781138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 552/1097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:00 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:00.843351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.851658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.854043 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:00.855308 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1c214bb3-35e5-4442-a29e-496b4b306887 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1675 microversion: 2.20 time: 0.278258 Sep 07 13:23:00.855949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 546/1098] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:00 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:01.091195 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0014671f-25b5-4090-9166-08ff6142a43d", "name": "network-vif-deleted", "tag": "876a0314-460e-41a9-9037-c75a08aa1c22"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:01.100890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.101372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.101803 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.116253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] Creating event network-vif-deleted:876a0314-460e-41a9-9037-c75a08aa1c22 for instance 0014671f-25b5-4090-9166-08ff6142a43d on hv-cinder-79053 Sep 07 13:23:01.121410 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-09e63010-cf29-4bd9-8067-a050a7ed0852 req-f6d5140d-49d9-491a-a343-2015f49cafae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034422 Sep 07 13:23:01.122009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 553/1099] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:01.803858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:01.804468 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:01.811702 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.812465 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.812903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.813591 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.814210 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.814660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.845506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.845986 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.846439 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.846913 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lazy-loading 'fault' on Instance uuid 0014671f-25b5-4090-9166-08ff6142a43d {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:23:01.881985 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:01.883458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:01.891319 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.891801 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.892269 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.892960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:01.893413 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:01.893832 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:01.941317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af213d2cc3140678f1f5ead207797da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5fb5c46aab43eba5f659ac73062dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:01.948956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4313b76c-80b2-4b63-9e55-1cfda74dd866 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 200 len: 1347 microversion: 2.1 time: 0.148873 Sep 07 13:23:01.949846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 547/1100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:01 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 1347 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:02.029484 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.039416 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.041184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:02.042358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fe11d861-ed25-4765-b6a1-49b417240706 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.165524 Sep 07 13:23:02.042957 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 554/1101] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:01 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:23:02.972289 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:02.973390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] [instance: 0014671f-25b5-4090-9166-08ff6142a43d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:02.981354 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:02.982245 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:02.982955 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:02.983928 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:02.984616 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:02.985374 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.004527 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] HTTP exception thrown: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Request method failure captured: Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d HTTP/1.1 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJqO36YgqIDgx_A702pIGjHkTqn6k2guJ0vOov1AyULa3xQ-FwBNW1q4Un0EJUoxVcO7AQCJuLh6mrppKT5mwibv5pCmjVXloWFfiLDXAUqw20tkIR2aTFWsrT679-Hf0HRWrUEtFdyvtaeews7HQw0ZiyAIVSd5Y9PrOikA4PHaGXQ Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: 3c5fb5c46aab43eba5f659ac73062dc7 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:23:03.006705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3c5fb5c46aab43eba5f659ac73062dc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 3c5fb5c46aab43eba5f659ac73062dc7 Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestMinimumBasicScenario-578254724 Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-TestMinimumBasicScenario-578254724-project Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 3af213d2cc3140678f1f5ead207797da Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestMinimumBasicScenario-578254724-project Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. Sep 07 13:23:03.008739 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '0014671f-25b5-4090-9166-08ff6142a43d'} Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:23:03.010518 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. Sep 07 13:23:03.013026 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:23:03.014766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Returning 404 to user: Instance 0014671f-25b5-4090-9166-08ff6142a43d could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:23:03.014766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9e4f16f0-29f9-41f5-b4c7-a716bc059155 tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d" status: 404 len: 111 microversion: 2.1 time: 0.044763 Sep 07 13:23:03.014766 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 548/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:02 2022] GET /compute/v2.1/servers/0014671f-25b5-4090-9166-08ff6142a43d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:03.021874 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-dec6c7e2-880a-47b0-b7a0-b6cf0e6c007c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] Calling method '.version_select at 0x7f7f2b6ad310>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:03.043353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-dec6c7e2-880a-47b0-b7a0-b6cf0e6c007c tempest-TestMinimumBasicScenario-578254724 tempest-TestMinimumBasicScenario-578254724-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-422032398" status: 202 len: 0 microversion: 2.1 time: 0.025116 Sep 07 13:23:03.044358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 555/1103] 10.222.0.65 () {58 vars in 1269 bytes} [Wed Sep 7 13:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-422032398 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:03.069279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:03.070453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:03.080380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.081656 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.083364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.084768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.088055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.088735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.276111 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.284947 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.286875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:03.288169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ecc60290-1b24-48df-9fae-25074469c59c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.223812 Sep 07 13:23:03.288814 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 549/1104] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:03 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:04.314149 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:04.314800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:04.332036 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:04.332958 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:04.333642 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:04.334554 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:04.335174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:04.335763 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:04.786612 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:04.800711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:04.803232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:04.817066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1e171073-e998-496f-9d8c-9f28d65d3dd3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.496001 Sep 07 13:23:04.817837 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 556/1105] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:04 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:05.853962 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:05.855236 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:05.862521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.863370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.864223 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.865161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:05.865852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:05.866519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:05.890761 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:06.423521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:06.433408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:06.436543 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:06.450315 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a128f73-32c8-4c77-8990-6c1c50625fbd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.600903 Sep 07 13:23:06.451903 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 550/1106] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:05 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:23:07.485586 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:07.492598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:07.509618 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:07.510114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:07.510815 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:07.511959 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:07.513052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:07.513483 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:07.797727 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:07.807321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:07.809383 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:07.810770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-37557f74-c7d9-41fa-86f7-e64e35e012ba tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.330399 Sep 07 13:23:07.811870 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 557/1107] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:07 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:08.838160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:08.838864 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:08.855196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:08.855614 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:08.856200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:08.857114 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:08.857632 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:08.858241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:09.040171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:09.062464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:09.064390 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:09.066661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69247830-ee66-4462-9725-f8bdb3c0cbb1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.233635 Sep 07 13:23:09.082457 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 551/1108] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:08 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:10.094827 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:10.095999 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:10.104863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:10.105672 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:10.106121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:10.106868 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:10.107358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:10.107984 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:10.261184 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:10.269489 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:10.270971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:10.272725 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2e9a6c73-ceb2-4d30-8d89-db3932765902 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.181353 Sep 07 13:23:10.272906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 558/1109] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:10 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:11.304476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:11.305659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:11.317196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:11.317196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:11.317196 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:11.317939 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:11.318926 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:11.319172 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:11.480899 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:11.489019 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:11.490627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:11.491868 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-11013d4e-8bd6-4fed-b1af-45d0c9703ae0 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.192283 Sep 07 13:23:11.492506 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 552/1110] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:11 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:12.518078 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:12.518495 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:12.527210 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:12.528009 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:12.528464 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:12.529180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:12.529639 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:12.530066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:12.666553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:12.674553 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:12.676032 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:12.677187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c27798f1-2403-4e6d-b36a-c5cd6d9c0f1c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.163835 Sep 07 13:23:12.677747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 559/1111] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:12 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:13.703002 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:13.703621 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:13.710202 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:13.710717 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:13.711157 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:13.711849 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:13.712306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:13.712914 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:13.841604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:13.849921 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:13.851394 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:13.852557 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ea08a443-2ba0-4a00-80c8-54d456644dcd tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.153495 Sep 07 13:23:13.853141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 553/1112] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:13 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:14.878340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:14.878963 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:14.886372 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:14.886919 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:14.887357 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:14.888044 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:14.888501 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:14.888924 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:15.019341 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:15.027520 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:15.028971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:15.030149 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-2f672ecf-9a0a-4c22-9f53-80bc94a0f1eb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.155914 Sep 07 13:23:15.030820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 560/1113] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:14 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:16.056968 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:16.057588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:16.063476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:16.063954 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:16.064419 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:16.065105 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:16.065558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:16.065984 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:16.200123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:16.208857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:16.210298 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:16.212032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c4564311-f333-464d-b084-1997cbca8df8 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.160260 Sep 07 13:23:16.212156 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 554/1114] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:16 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:17.237257 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:17.237873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:17.244776 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:17.245384 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:17.245861 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:17.246634 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:17.247113 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:17.247581 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:17.397940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:17.406920 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:17.408347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:17.409505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb5a0d95-af3b-466c-bdff-9bb9f1b32dc1 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.176270 Sep 07 13:23:17.422462 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 561/1115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:17 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:17.476949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "name": "network-vif-plugged", "status": "completed", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:17.487688 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:17.488169 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:17.488620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:17.500108 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] Creating event network-vif-plugged:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:23:17.505148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-ce4e6258-88d8-41aa-9ddf-7ac1b69200a6 req-a69f23de-ceb2-4623-b788-1c1ca227c4f9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032250 Sep 07 13:23:17.505736 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 555/1116] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:18.436508 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:18.437124 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:18.443601 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:18.444083 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:18.444519 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:18.445205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:18.445655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:18.446079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:18.581348 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:18.590761 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:18.592323 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:18.593558 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f01cb43e-2281-4f33-87c1-2c2e1165a02f tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.161228 Sep 07 13:23:18.594160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 562/1117] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:18 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:19.622171 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:19.622908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:19.629131 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:19.629615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:19.630055 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:19.630784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:19.631290 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:19.631659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:19.786846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:19.795466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:19.796956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:19.798231 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7693d23b-743e-421c-827d-661a578f213c tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1731 microversion: 2.20 time: 0.180936 Sep 07 13:23:19.798823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 556/1118] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:19 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:20.835252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:20.835789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:20.842610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:20.843097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:20.843537 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:20.844229 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:20.844687 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:20.845178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:20.979531 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:20.987728 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:20.989169 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:20.990314 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-c77df894-710d-4f57-8466-ade4370cdf53 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1718 microversion: 2.20 time: 0.169810 Sep 07 13:23:20.990905 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 563/1119] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:20 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:23:59.578129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.580299 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.582432 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:59.583082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=37 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:59.589599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.590078 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.590542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.591321 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.591882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.592306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.623881 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-44f5bb82-4ee4-4111-b5d3-d31760908ca3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050020 Sep 07 13:23:59.624422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 557/1120] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:59.688791 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.689404 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.691662 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:59.692414 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=58 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:59.698607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.699107 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.699548 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.700253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.700714 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.701147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.728782 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:23:59.803709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-3ce491f0-461e-43d6-913a-746ae33fb158 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 204 len: 0 microversion: 2.20 time: 0.118777 Sep 07 13:23:59.804216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 564/1121] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Sep 7 13:23:59 2022] DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:23:59.813852 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.814509 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.820438 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.820942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.821370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.822373 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.822882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.823302 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.952754 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.960809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.962235 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.963421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4cddb413-172c-4a17-86c7-4721866997c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.154595 Sep 07 13:23:59.964297 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 558/1122] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:00.989786 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:00.990515 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:00.996804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:00.997288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:00.998387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:00.999108 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:00.999566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:00.999993 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.130252 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.138713 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.140183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.141354 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-7e33838b-adb3-44d3-b0a0-0ce8f596d99b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1724 microversion: 2.20 time: 0.155874 Sep 07 13:24:01.141915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 565/1123] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:00 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:02.166738 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:02.167264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:02.173437 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.173948 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.174466 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.175191 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.175709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.176160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.268848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:02.276908 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:02.278348 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:02.280032 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dcedaecd-2061-4e99-a218-cf758bb3bf1b tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1656 microversion: 2.20 time: 0.117800 Sep 07 13:24:02.280620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 559/1124] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:02 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:02.636128 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fcfa63-f894-4105-b24f-ba1a9afc6db3", "name": "network-vif-deleted", "tag": "f2638491-1376-4037-83b2-7a1e8bd45d14"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:02.648739 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.649910 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.650350 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.661885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] Creating event network-vif-deleted:f2638491-1376-4037-83b2-7a1e8bd45d14 for instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 on hv-cinder-79053 Sep 07 13:24:02.667719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-33b1ba9b-584e-469a-a025-353fc26f7ab3 req-6907636c-add9-4f6c-9143-8897fc8f57e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035303 Sep 07 13:24:02.668538 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 566/1125] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:03.305411 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:03.306041 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:03.313659 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.314154 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.314642 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.315358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.315826 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.316258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.351262 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.351760 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.352464 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.352923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lazy-loading 'fault' on Instance uuid 22fcfa63-f894-4105-b24f-ba1a9afc6db3 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:03.398134 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.407224 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.408678 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e08e973fed47618d748df8defa665b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32197c49dda403aa8c184ca2c7426ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.409846 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e37b562a-d2b1-4646-ae70-07abaf1d57c9 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 200 len: 1372 microversion: 2.20 time: 0.108558 Sep 07 13:24:03.410504 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 560/1126] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:03 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:24:04.434944 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:04.435867 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:04.442479 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.442960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.443400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.444081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.444549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.444953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.458209 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 HTTP/1.1 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:24:04.459797 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:04.461670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '22fcfa63-f894-4105-b24f-ba1a9afc6db3'} Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:04.462707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:04.464458 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:04.466005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:04.466005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4bcdfcbf-ce0c-44eb-9cc8-2f7893aec7cf tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 404 len: 111 microversion: 2.20 time: 0.030522 Sep 07 13:24:04.466005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 567/1127] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:04 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:24:04.470349 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-69c58ba9-a54e-468a-b2e3-e3b3414e81af tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '.version_select at 0x7f7f2b673940>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:04.474793 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69c58ba9-a54e-468a-b2e3-e3b3414e81af tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [bf722e44-5ce5-4733-a24d-8df3f344ec81] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:24:05.484436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [None req-69c58ba9-a54e-468a-b2e3-e3b3414e81af tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [bf722e44-5ce5-4733-a24d-8df3f344ec81] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 45078. Sep 07 13:24:05.504097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-69c58ba9-a54e-468a-b2e3-e3b3414e81af tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088972234" status: 204 len: 0 microversion: 2.20 time: 1.037870 Sep 07 13:24:05.504686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 561/1128] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Sep 7 13:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088972234 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:24:05.590012 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:05.591197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4596378e-5af7-4b9c-b6b6-d69421c2d5ae", "tag": "2ffb3b1e-7447-4a3b-beb1-3b555cf203cc"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:05.591452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:05.600396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.601284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.601979 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.603300 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.604011 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.604520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.605011 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.605315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.605435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.616238 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] Creating event network-changed:2ffb3b1e-7447-4a3b-beb1-3b555cf203cc for instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae on hv-cinder-79053 Sep 07 13:24:05.621769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-a8d97b04-5cfa-4143-82d2-45ecff50859a req-e5e6d7f3-5b93-4ce9-845a-becd991fd196 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Sep 07 13:24:05.626501 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 562/1129] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:05.643719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:05.754025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-019498a9-6a2e-4fe5-ab7d-4eeac46584bf tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 204 len: 0 microversion: 2.1 time: 0.168481 Sep 07 13:24:05.756565 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 568/1130] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:05 2022] DELETE /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:05.768401 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:05.770821 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:05.778068 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.779150 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.779995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.781009 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.781705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.782369 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.013875 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.022584 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aaa624d4-3ffb-40db-a30c-b01e5422b63b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1579 microversion: 2.1 time: 0.260754 Sep 07 13:24:06.023368 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 563/1131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:05 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:07.050736 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.051353 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.057762 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.058251 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.058725 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.059421 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.059911 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.060370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.194964 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:07.202824 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f87320b0-d2d7-49fd-a4b3-f4ec70182116 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1579 microversion: 2.1 time: 0.157196 Sep 07 13:24:07.203606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 569/1132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:07 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:07.446620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.447124 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.453495 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.453999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.454461 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.455148 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.455604 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.456186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.471952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 HTTP/1.1 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:24:07.473673 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.475274 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '22fcfa63-f894-4105-b24f-ba1a9afc6db3'} Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:07.476082 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.477679 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.479022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:07.479022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-34ce940f-ff06-4c5b-a21a-a30533362abb tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 404 len: 111 microversion: 2.20 time: 0.032340 Sep 07 13:24:07.479022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 564/1133] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Sep 7 13:24:07 2022] DELETE /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:24:07.484090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.484708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: 22fcfa63-f894-4105-b24f-ba1a9afc6db3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.491577 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.492063 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.492505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.493187 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.493641 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.494066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.507049 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 HTTP/1.1 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:24:07.508661 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.510396 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '22fcfa63-f894-4105-b24f-ba1a9afc6db3'} Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:07.511567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. Sep 07 13:24:07.513159 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:07.514655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance 22fcfa63-f894-4105-b24f-ba1a9afc6db3 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:07.514655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4a0c8535-c9fb-4c3a-b2fd-02b79f590e63 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3" status: 404 len: 111 microversion: 2.20 time: 0.029866 Sep 07 13:24:07.514655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 570/1134] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:07 2022] GET /compute/v2.1/servers/22fcfa63-f894-4105-b24f-ba1a9afc6db3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:24:08.225576 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:08.226190 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:08.232351 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.232831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.233261 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.233944 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.234398 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.234849 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.306725 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.314720 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4ab71578-c136-490f-8bdc-66bab5af6c63 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1393 microversion: 2.1 time: 0.093429 Sep 07 13:24:08.315879 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 565/1135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:08 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1393 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:08.341651 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4596378e-5af7-4b9c-b6b6-d69421c2d5ae", "name": "network-vif-deleted", "tag": "2ffb3b1e-7447-4a3b-beb1-3b555cf203cc"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:08.354112 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.354629 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.355066 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.371882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] Creating event network-vif-deleted:2ffb3b1e-7447-4a3b-beb1-3b555cf203cc for instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae on hv-cinder-79053 Sep 07 13:24:08.377817 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-f7a1e732-e150-4daf-9cf5-2cd8c9ba658a req-36b8a6fb-7910-43e3-b805-8d44c1ca7716 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039012 Sep 07 13:24:08.378682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 571/1136] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:08.649687 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:08.650264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:08.657035 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.657636 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.658142 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.659062 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.659595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.660097 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.675001 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 HTTP/1.1 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:24:08.676626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.678364 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'bdbf7c6a-056e-45e0-a43d-682c3c3fda84'} Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:08.679347 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.680862 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.682161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:08.682161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-92e127d9-6ad5-4baf-8b9d-9d34ed971ee5 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 404 len: 111 microversion: 2.20 time: 0.033923 Sep 07 13:24:08.682161 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 566/1137] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Sep 7 13:24:08 2022] DELETE /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:24:08.689211 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:08.690719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] [instance: bdbf7c6a-056e-45e0-a43d-682c3c3fda84] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:08.697611 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.698404 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.699103 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.700028 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.700557 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.701067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.716682 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] HTTP exception thrown: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Request method failure captured: Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 HTTP/1.1 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJn8toYYK2e8HiyDZH3vMn4mXv0rgWgss76EAiqcgW3YvfovnwGcdWz40ZGvkXXpYeMUc7EFBNXnXtPn-0yIL1eQeCzufBav1RiFLzGpR2xQP8kyyQd5b3tjMhwSvZ7h3yIn29dhJRmbnz5v9U3IFWGBGNJ-PUemNf_A3Oe2hIxB41A Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:24:08.718718 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c32197c49dda403aa8c184ca2c7426ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: c32197c49dda403aa8c184ca2c7426ab Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236088594 Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: 31e08e973fed47618d748df8defa665b Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236088594-project Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.720726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'bdbf7c6a-056e-45e0-a43d-682c3c3fda84'} Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:08.721701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. Sep 07 13:24:08.723339 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:08.724643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] Returning 404 to user: Instance bdbf7c6a-056e-45e0-a43d-682c3c3fda84 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:08.724643 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-86b20ace-fb6a-4a58-9f66-bf38aa22fbb3 tempest-AttachVolumeShelveTestJSON-236088594 tempest-AttachVolumeShelveTestJSON-236088594-project] 10.222.0.65 "GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84" status: 404 len: 111 microversion: 2.20 time: 0.035486 Sep 07 13:24:08.729006 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 572/1138] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Sep 7 13:24:08 2022] GET /compute/v2.1/servers/bdbf7c6a-056e-45e0-a43d-682c3c3fda84 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:24:09.348792 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:09.349445 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:09.356830 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.357317 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.357953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.358857 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.359309 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.359735 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.395602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.396241 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.396848 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.397370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lazy-loading 'fault' on Instance uuid 4596378e-5af7-4b9c-b6b6-d69421c2d5ae {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:09.449894 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:09.457523 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5c57205-37eb-42e8-8f0f-0a7ac84188ec tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 200 len: 1185 microversion: 2.1 time: 0.114935 Sep 07 13:24:09.458019 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 567/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:09 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 1185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:10.481507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:10.482552 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 4596378e-5af7-4b9c-b6b6-d69421c2d5ae] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:10.490550 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.491212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.491784 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.492781 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.493349 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.493885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.509987 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] HTTP exception thrown: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Request method failure captured: Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae HTTP/1.1 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJmaKxRcoRa4vZALEpkF1z_wXVEWra3AuVlT9OKzuHYNip082B8ECvyV1brATkrQ1Z5tXpyjFgR7t-3BanS2pCK0x4aaU_O93uc5zPJh_0CWqafF4v1fliKZzV-a2gjkh6YzDu2coTBVL6vtFT1b3-AouNSDA_txX9w4QfUKr9rJHn0 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:24:10.511189 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: bf4f0ec8413644aea92cd53c1e54b5d7 Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. Sep 07 13:24:10.512980 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '4596378e-5af7-4b9c-b6b6-d69421c2d5ae'} Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:10.513953 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. Sep 07 13:24:10.515525 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:10.516956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Returning 404 to user: Instance 4596378e-5af7-4b9c-b6b6-d69421c2d5ae could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:10.516956 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-32b0dc98-434e-4f8b-88cd-5dd97971396a tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae" status: 404 len: 111 microversion: 2.1 time: 0.037082 Sep 07 13:24:10.520219 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 573/1140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:10 2022] GET /compute/v2.1/servers/4596378e-5af7-4b9c-b6b6-d69421c2d5ae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:13.704733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:13.706690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:13.713019 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666a55f8-f232-47ab-a454-82d312d42ea3", "tag": "40e471cd-2b9d-4047-a762-2191e2b9981d"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:13.714547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.715237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.715858 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.720819 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.721583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.722753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.728852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.731094 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.733596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.749618 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:13.751915 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] Creating event network-changed:40e471cd-2b9d-4047-a762-2191e2b9981d for instance 666a55f8-f232-47ab-a454-82d312d42ea3 on hv-cinder-79053 Sep 07 13:24:13.757622 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-d0af5c36-e9e0-4009-97c9-d9956d82aca9 req-6dc9358b-cf2c-4efb-874d-c424651fbb80 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048153 Sep 07 13:24:13.758598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 574/1141] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:13.843018 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-50d8c404-e799-4c9c-be4f-8cda6d943887 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "DELETE /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 204 len: 0 microversion: 2.1 time: 0.141672 Sep 07 13:24:13.844416 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 568/1142] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:13 2022] DELETE /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:13.855949 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:13.856971 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:13.866388 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.867368 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.868083 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.869014 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.869921 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.870604 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:14.027266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:14.036889 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-fe4a4b59-fd0f-40bc-b8be-5757b9f685d7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1579 microversion: 2.1 time: 0.186651 Sep 07 13:24:14.037906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 575/1143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:13 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1579 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:15.061423 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:15.062047 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:15.069164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.069654 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.070094 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.070823 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.071284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.071714 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.209301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.217237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b630d5d8-c02b-46ce-b264-47aa0601b587 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1579 microversion: 2.1 time: 0.160192 Sep 07 13:24:15.217807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 569/1144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:15 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:16.242387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:16.243140 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:16.249243 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.249800 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.250310 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.251096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.251547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.251977 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.318864 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:16.327188 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb688143-d620-4dac-b227-55bce676753f tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1393 microversion: 2.1 time: 0.088619 Sep 07 13:24:16.327773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 576/1145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:16 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:16.357280 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666a55f8-f232-47ab-a454-82d312d42ea3", "name": "network-vif-deleted", "tag": "40e471cd-2b9d-4047-a762-2191e2b9981d"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:16.368072 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.368546 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.368972 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.380681 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] Creating event network-vif-deleted:40e471cd-2b9d-4047-a762-2191e2b9981d for instance 666a55f8-f232-47ab-a454-82d312d42ea3 on hv-cinder-79053 Sep 07 13:24:16.385435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-46955f2f-4dc8-424a-b472-7e155b7bbc1f req-0a0e8e88-8ef4-4492-9fef-42d7b675477f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Sep 07 13:24:16.386052 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 570/1146] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:17.349266 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:17.349887 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:17.356640 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:17.357121 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:17.357685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:17.358454 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:17.358970 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:17.359347 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:17.395387 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:17.395872 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:17.396311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:17.396756 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lazy-loading 'fault' on Instance uuid 666a55f8-f232-47ab-a454-82d312d42ea3 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:17.436090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:17.444204 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-bf2a9b8b-db94-4d78-be82-f88bf3c8d892 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1231 microversion: 2.1 time: 0.098829 Sep 07 13:24:17.444769 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 577/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:17 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:18.467973 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:18.468611 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:18.474768 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.475237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.475665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.476344 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.476791 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.477208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.507993 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.508460 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.508889 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.509325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lazy-loading 'fault' on Instance uuid 666a55f8-f232-47ab-a454-82d312d42ea3 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:18.551077 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:18.558784 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-05e9f7bc-d5d4-4ad6-bf46-9180fec1c86d tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1231 microversion: 2.1 time: 0.095532 Sep 07 13:24:18.559346 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 571/1148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:18 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:19.582234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:19.582906 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:19.589104 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.589584 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.590018 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.590726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.591176 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.591595 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.622361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.622858 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.623289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.623726 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lazy-loading 'fault' on Instance uuid 666a55f8-f232-47ab-a454-82d312d42ea3 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:19.664301 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4f0ec8413644aea92cd53c1e54b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e272b3e5ef9244098642eef1a8c4be51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:19.672020 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4f9c8e8e-507c-4695-855b-d2326aa74522 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 200 len: 1231 microversion: 2.1 time: 0.094172 Sep 07 13:24:19.672585 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 578/1149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:19 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:20.696022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:20.696605 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: 666a55f8-f232-47ab-a454-82d312d42ea3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:20.703251 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.703744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.704212 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.704933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.705475 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.705937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.719700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] HTTP exception thrown: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Request method failure captured: Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 HTTP/1.1 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJmaKxRcoRa4vZALEpkF1z_wXVEWra3AuVlT9OKzuHYNip082B8ECvyV1brATkrQ1Z5tXpyjFgR7t-3BanS2pCK0x4aaU_O93uc5zPJh_0CWqafF4v1fliKZzV-a2gjkh6YzDu2coTBVL6vtFT1b3-AouNSDA_txX9w4QfUKr9rJHn0 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:24:20.721352 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bf4f0ec8413644aea92cd53c1e54b5d7 Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. Sep 07 13:24:20.723306 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '666a55f8-f232-47ab-a454-82d312d42ea3'} Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:20.724314 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. Sep 07 13:24:20.725965 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:20.727549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Returning 404 to user: Instance 666a55f8-f232-47ab-a454-82d312d42ea3 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:20.727549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c79565db-dc4e-4a1e-aeeb-e79a055aca16 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3" status: 404 len: 111 microversion: 2.1 time: 0.030746 Sep 07 13:24:20.727549 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 572/1150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:20 2022] GET /compute/v2.1/servers/666a55f8-f232-47ab-a454-82d312d42ea3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:21.156290 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:21.156828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:21.163807 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.164295 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.164737 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.165436 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.165894 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.166358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.180079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] HTTP exception thrown: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Request method failure captured: Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: DELETE /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a HTTP/1.1 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJmaKxRcoRa4vZALEpkF1z_wXVEWra3AuVlT9OKzuHYNip082B8ECvyV1brATkrQ1Z5tXpyjFgR7t-3BanS2pCK0x4aaU_O93uc5zPJh_0CWqafF4v1fliKZzV-a2gjkh6YzDu2coTBVL6vtFT1b3-AouNSDA_txX9w4QfUKr9rJHn0 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:24:21.181752 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: bf4f0ec8413644aea92cd53c1e54b5d7 Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.183523 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': 'be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a'} Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:21.187655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.189253 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.191013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Returning 404 to user: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:21.191013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-a25c50cc-21b4-4a3c-b91c-3bc573dc1b4b tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "DELETE /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 404 len: 111 microversion: 2.1 time: 0.030834 Sep 07 13:24:21.191013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 579/1151] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:21 2022] DELETE /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:21.191851 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:21.192470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] [instance: be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:21.198508 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.198995 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.199436 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.200134 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:21.200590 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:21.201022 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:21.217211 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] HTTP exception thrown: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Request method failure captured: Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a HTTP/1.1 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJmaKxRcoRa4vZALEpkF1z_wXVEWra3AuVlT9OKzuHYNip082B8ECvyV1brATkrQ1Z5tXpyjFgR7t-3BanS2pCK0x4aaU_O93uc5zPJh_0CWqafF4v1fliKZzV-a2gjkh6YzDu2coTBVL6vtFT1b3-AouNSDA_txX9w4QfUKr9rJHn0 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:24:21.218779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e272b3e5ef9244098642eef1a8c4be51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: e272b3e5ef9244098642eef1a8c4be51 Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestVolumeBootPattern-682269922 Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: bf4f0ec8413644aea92cd53c1e54b5d7 Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestVolumeBootPattern-682269922-project Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.220267 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': 'be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a'} Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:21.221187 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. Sep 07 13:24:21.223378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:21.224991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Returning 404 to user: Instance be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:21.224991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4ae94d6d-54c4-4081-8154-24ddbbe516b7 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a" status: 404 len: 111 microversion: 2.1 time: 0.032166 Sep 07 13:24:21.224991 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 573/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:21 2022] GET /compute/v2.1/servers/be7fcf3e-7dbd-4dcd-b3c3-74bf77f4665a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:24:22.529510 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e28fdb4e-c927-4861-aae0-1f88a423f610 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] Calling method '.version_select at 0x7f7f2b6d8b80>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:22.549374 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e28fdb4e-c927-4861-aae0-1f88a423f610 tempest-TestVolumeBootPattern-682269922 tempest-TestVolumeBootPattern-682269922-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2047053971" status: 202 len: 0 microversion: 2.1 time: 0.023412 Sep 07 13:24:22.550000 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 580/1153] 10.222.0.65 () {58 vars in 1263 bytes} [Wed Sep 7 13:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2047053971 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:42.885902 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1533590449", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "networks": [{"uuid": "5b0b237e-0310-44dc-bb21-fc3e818c4934"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:42.895049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.895701 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:42.946570 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] validate_networks() for [('5b0b237e-0310-44dc-bb21-fc3e818c4934', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:24:43.351719 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:24:43.352145 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:24:43.352638 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:24:43.353038 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:24:43.353454 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:24:43.362682 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.363164 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.364115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.364842 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:43.365303 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:43.365733 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:43.383029 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Getting quotas for project bc90c1480c0f4bb187aa2cd7988adc54. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:24:43.387040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Getting quotas for user b485936b2671428c90e53dca7fe3dfba and project bc90c1480c0f4bb187aa2cd7988adc54. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:24:43.398956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:24:43.401208 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:24:43.448435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fa773a56-ceea-4859-91e4-8aa8a4c14e21 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566257 Sep 07 13:24:43.449115 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 574/1154] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:24:43.459155 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:43.459988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:43.469598 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-41292cdd-9f14-4f57-9db1-d5cd1f94b2a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:43.470249 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-41292cdd-9f14-4f57-9db1-d5cd1f94b2a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:43.535232 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-41292cdd-9f14-4f57-9db1-d5cd1f94b2a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:43.542796 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-41292cdd-9f14-4f57-9db1-d5cd1f94b2a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1214 microversion: 2.1 time: 0.086485 Sep 07 13:24:43.543360 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 581/1155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:43 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:44.565623 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:44.566243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:44.572937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.573423 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.573866 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.574599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:44.575061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:44.576264 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:44.659697 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:44.668581 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ed585643-628a-4934-ae82-46d798a01d26 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1274 microversion: 2.1 time: 0.106874 Sep 07 13:24:44.670113 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 575/1156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:44 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:45.692224 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:45.692897 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:45.698831 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.699315 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.699749 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.700439 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.700890 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.701316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:45.834570 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:45.842446 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d9a34fcb-e8d5-406d-be8e-4e83a764a9d1 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.154334 Sep 07 13:24:45.843031 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 582/1157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:45 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:45.974767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f07ac01-f634-4691-bc43-6e716f2c5b09", "tag": "d8ce0278-dedf-4683-ab42-0baf920c8d3b"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:45.987362 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:45.987938 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:45.989371 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.000759 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] Creating event network-changed:d8ce0278-dedf-4683-ab42-0baf920c8d3b for instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 on hv-cinder-79053 Sep 07 13:24:46.006525 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-7c7c8653-58a2-40d1-b70d-7689010a71d7 req-f26003d2-1453-4d4d-b934-fbb6fbfc2ea2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Sep 07 13:24:46.007129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 576/1158] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:46.866386 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:46.867038 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:46.873220 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.873694 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.874126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:46.874835 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:46.875281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:46.875697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:47.005166 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:47.012746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6d148e86-0d2f-43d7-8f31-cb1a15659efa tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.150438 Sep 07 13:24:47.013306 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 583/1159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:46 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:48.036595 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:48.037199 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:48.043453 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.043927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.044357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.045031 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:48.045478 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:48.045897 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:48.173119 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:48.180832 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-79c1f69e-9bce-45b5-8ddc-944eac40c11a tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.148689 Sep 07 13:24:48.181396 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 577/1160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:48 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:49.203459 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:49.204098 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:49.211177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.211660 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.212096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.212792 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:49.213245 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:49.213669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:49.342061 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:49.350370 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-781cd70a-6627-4bf7-a92a-397d69ce2e19 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.150762 Sep 07 13:24:49.350961 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 584/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:49 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:50.373108 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:50.373757 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:50.380994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.381488 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.381929 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.382662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:50.383120 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:50.383550 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:50.517345 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:50.526424 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b93943d-5cf2-4e3b-bba6-8d821a020ce2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.157290 Sep 07 13:24:50.527004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 578/1162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:50 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:51.549076 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:51.549608 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:51.556055 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.556542 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.556988 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.557690 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:51.558147 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:51.558599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:51.683625 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:51.691208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cf13328b-c49e-46ea-b867-3e784719e507 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.146115 Sep 07 13:24:51.691770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 585/1163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:51 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:52.046213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f07ac01-f634-4691-bc43-6e716f2c5b09", "name": "network-vif-plugged", "status": "completed", "tag": "d8ce0278-dedf-4683-ab42-0baf920c8d3b"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:52.057358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.057855 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.058288 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.069408 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] Creating event network-vif-plugged:d8ce0278-dedf-4683-ab42-0baf920c8d3b for instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 on hv-cinder-79053 Sep 07 13:24:52.074284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-7eae8b19-84aa-4032-be3e-4e72f3b0b609 req-442dd23a-5497-41e1-96f7-11512d6c3097 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Sep 07 13:24:52.074911 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 579/1164] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:52.714907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:52.715564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:52.721843 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.722324 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.722789 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.723691 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.724145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.724566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.859785 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.867747 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-4931acbe-5e99-4196-8eab-577456138403 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1314 microversion: 2.1 time: 0.156630 Sep 07 13:24:52.868340 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 586/1165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:52 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:53.889102 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:53.889865 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:53.894554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.895284 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:53.902181 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.902685 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.903117 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.903797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.904243 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.904662 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.037418 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.045246 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0d8fc59f-258e-454a-99d3-b7706938bc84 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1497 microversion: 2.1 time: 0.158282 Sep 07 13:24:54.045809 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 580/1166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:54.586770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.587289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.589190 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:54.595051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.595541 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.595982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.596676 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.597205 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.597566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.623106 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Going to try to terminate instance {{(pid=120737) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:54.700234 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-160a1254-800a-4dc1-bd9a-ad708abc32af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 204 len: 0 microversion: 2.1 time: 0.117511 Sep 07 13:24:54.700928 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 587/1167] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:54 2022] DELETE /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:54.711049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.711653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.717597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.718081 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.718558 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.719250 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.719709 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.720140 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.851421 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.859338 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a2e0eb48-78b8-4b13-9e77-57d39138ed4d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1503 microversion: 2.1 time: 0.153192 Sep 07 13:24:54.859909 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 581/1168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:55.883334 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:55.884052 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:55.890678 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.891165 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.891606 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:55.892303 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:55.892873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:55.893302 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.023724 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:56.031376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-f209034e-d199-4a14-93ac-6c1a9f09f010 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1503 microversion: 2.1 time: 0.152858 Sep 07 13:24:56.031942 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 588/1169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:55 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:56.906129 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f07ac01-f634-4691-bc43-6e716f2c5b09", "name": "network-vif-deleted", "tag": "d8ce0278-dedf-4683-ab42-0baf920c8d3b"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:56.917103 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:56.917583 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:56.918013 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.929253 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] Creating event network-vif-deleted:d8ce0278-dedf-4683-ab42-0baf920c8d3b for instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 on hv-cinder-79053 Sep 07 13:24:56.934081 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-2ed1489a-0885-4ea4-82bb-2f062e33c7bb req-0a5332ac-06c4-499e-b1c7-4d2c631004cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Sep 07 13:24:56.934888 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 582/1170] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:57.053565 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.054185 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:57.060665 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.061152 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.061590 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.062288 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.062779 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.063208 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.097248 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.097655 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.098090 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.098588 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.objects.instance [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lazy-loading 'fault' on Instance uuid 5f07ac01-f634-4691-bc43-6e716f2c5b09 {{(pid=120737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:57.143402 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.151766 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9eabcd17-6e12-4c0c-83c9-ab146233e669 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 200 len: 1304 microversion: 2.1 time: 0.102444 Sep 07 13:24:57.152333 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 589/1171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:57 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:58.175896 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.176602 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 5f07ac01-f634-4691-bc43-6e716f2c5b09] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.182807 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.183285 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.183711 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.184387 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.184834 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.185249 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.198378 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] HTTP exception thrown: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Request method failure captured: Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 HTTP/1.1 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Connection: close Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Host: 10.222.0.65 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjGJuZmVaTgUokW9AAblRjvTETDeTsKo5QHbIA2f3J_6-Hz34gsF2PRcQvVXl6zDtDsgfQa4HoP36KprGTfJaCTskSEq5Q5PSeI5vDDtuSDzXXbZdVw7Yvj1pqRvHfxeQzRNAJvhaL1KGXa8GF5ICwRdcYtBw36QQpbCkiNWS_cebSp00 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Id: bc90c1480c0f4bb187aa2cd7988adc54 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesActionsTest-1301647681 Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 07 13:24:58.200006 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesActionsTest-1301647681 Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Id: bc90c1480c0f4bb187aa2cd7988adc54 Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesActionsTest-1301647681 Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesActionsTest-1301647681-project Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Id: b485936b2671428c90e53dca7fe3dfba Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesActionsTest-1301647681-project Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: method: > Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: exception: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. Sep 07 13:24:58.201937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: action_args: {'id': '5f07ac01-f634-4691-bc43-6e716f2c5b09'} Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:58.203130 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. Sep 07 13:24:58.204930 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 07 13:24:58.206271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Returning 404 to user: Instance 5f07ac01-f634-4691-bc43-6e716f2c5b09 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:58.206271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-871c326d-d6a9-4810-b8ee-ee03adc0335c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09" status: 404 len: 111 microversion: 2.1 time: 0.030234 Sep 07 13:24:58.206271 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 583/1172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/5f07ac01-f634-4691-bc43-6e716f2c5b09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:58.252361 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449898636", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452", "networks": [{"uuid": "5b0b237e-0310-44dc-bb21-fc3e818c4934"}]}} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:58.305567 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.network.neutron [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] validate_networks() for [('5b0b237e-0310-44dc-bb21-fc3e818c4934', None, None, None, None, None)] {{(pid=120737) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:24:58.704192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Flavor limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:24:58.704610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Image limits 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:24:58.705079 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Flavor pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:24:58.705482 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Image pref 0:0:0 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:24:58.705886 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.virt.hardware [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:24:58.714668 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.715145 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.715574 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.716284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.716731 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.717149 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.734192 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Getting quotas for project bc90c1480c0f4bb187aa2cd7988adc54. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:24:58.738233 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.quota [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Getting quotas for user b485936b2671428c90e53dca7fe3dfba and project bc90c1480c0f4bb187aa2cd7988adc54. Resources: {'cores', 'ram', 'instances'} {{(pid=120737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:24:58.750814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Going to run 1 instances... {{(pid=120737) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:24:58.753138 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:24:58.799907 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-6a6090e3-5091-406c-9131-2bfd5a15c5f2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551379 Sep 07 13:24:58.800560 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 590/1173] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:24:58.812183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-000521ab-7b98-4ce3-a4d6-bfe0c02386a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.812802 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-000521ab-7b98-4ce3-a4d6-bfe0c02386a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.868689 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-000521ab-7b98-4ce3-a4d6-bfe0c02386a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:58.875536 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-000521ab-7b98-4ce3-a4d6-bfe0c02386a2 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1214 microversion: 2.1 time: 0.067235 Sep 07 13:24:58.876099 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 584/1174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:59.899322 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:59.900053 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:59.907709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.908237 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.909225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.909939 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:59.910596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:59.911042 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.979096 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.987432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-ba3caa30-c2df-47a6-80aa-13fadcfd5e59 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1274 microversion: 2.1 time: 0.092674 Sep 07 13:24:59.988025 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 591/1175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:59 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:01.011040 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:01.011674 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:01.019353 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.019850 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.020333 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.021049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.021511 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.021949 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.253607 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.261933 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fae63be4-5cda-4bd3-be6f-733672ec6763 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.254719 Sep 07 13:25:01.262519 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 585/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:01 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:01.600940 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40595cbc-9335-4a2f-b52d-e3a702b860f7", "tag": "40515bb4-71f0-4f7b-bf0f-fdf1c20e089c"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:01.613466 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.614097 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.614706 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.628013 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] Creating event network-changed:40515bb4-71f0-4f7b-bf0f-fdf1c20e089c for instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 on hv-cinder-79053 Sep 07 13:25:01.633823 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-8ad75e1c-e9a1-4a3a-ac3f-3e88e56dcd7a req-d47b5344-e6dd-44b2-86b1-3699188749a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036599 Sep 07 13:25:01.634432 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 592/1177] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:02.289139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.290257 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.301542 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.301989 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.302458 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.303216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.304618 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.304990 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.444895 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:02.452575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7b52b584-65ab-41d0-a40b-75f351f4809c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.171195 Sep 07 13:25:02.453135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 586/1178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:03.475982 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:03.476758 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:03.483636 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.484119 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.484559 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.485247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.485711 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.486180 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.615507 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.623857 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-de362382-a7ae-4ee6-a968-d10769c50c1d tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.152290 Sep 07 13:25:03.624408 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 593/1179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:03 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:04.647416 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:04.648070 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:04.654671 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.655159 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.655599 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.656291 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.656753 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.657183 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.786044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.794482 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-faf38063-ac1b-4728-b9ae-60e751ea6218 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.151243 Sep 07 13:25:04.795049 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 587/1180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:04 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:05.817312 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.818005 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.825225 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.825721 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.826160 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.826881 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.827343 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.827770 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.961568 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.969133 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5053b479-584b-4cb1-9ed9-3f2d7a84e589 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.155883 Sep 07 13:25:05.969701 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 594/1181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:06.992665 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.993193 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:06.999648 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.000160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.000660 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.001343 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.001798 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.002222 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.129279 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:07.137715 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a2eda23-4707-4365-bf76-1ce251598e72 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.149238 Sep 07 13:25:07.138275 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 588/1182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:08.163706 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40595cbc-9335-4a2f-b52d-e3a702b860f7", "name": "network-vif-plugged", "status": "completed", "tag": "40515bb4-71f0-4f7b-bf0f-fdf1c20e089c"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:08.169646 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:08.170284 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:08.187729 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.189299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.189861 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.190358 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.190829 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.195289 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.196709 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.197400 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.197846 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.220375 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] Creating event network-vif-plugged:40515bb4-71f0-4f7b-bf0f-fdf1c20e089c for instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 on hv-cinder-79053 Sep 07 13:25:08.229600 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-d95ff5d6-a071-4ced-a29c-f39869be9ef6 req-b308aa1c-3487-439f-850b-a63b6dfff1e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070787 Sep 07 13:25:08.230214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 589/1183] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:08.351824 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.359707 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-d080361b-57f0-47ae-8c30-3450900f5576 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.202875 Sep 07 13:25:08.360281 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 595/1184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:08 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:09.380878 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:09.385562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:09.386258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:09.392661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.393139 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.393572 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.394259 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.395311 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.395923 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.532226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.540615 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-92a0f848-7732-4c4e-ae06-c5ee9b4ef4ac tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1314 microversion: 2.1 time: 0.160683 Sep 07 13:25:09.541186 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 590/1185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:09 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:10.563171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:10.563852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:10.565809 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:10.567065 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=6 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:10.573632 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.574109 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.574578 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.575260 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.575710 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.576126 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.710379 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.718329 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-54a0be3d-fb6d-47cd-ad85-faba098c6a57 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1496 microversion: 2.1 time: 0.158990 Sep 07 13:25:10.718927 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 596/1186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1496 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:11.273435 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.273999 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.280619 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.281101 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.281547 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.282237 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.282716 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.283142 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.309141 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:25:11.385301 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-52fa0f47-12a4-475b-9ea4-b6e16068fd3c tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "DELETE /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 204 len: 0 microversion: 2.1 time: 0.115202 Sep 07 13:25:11.386192 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 591/1187] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:11 2022] DELETE /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:25:11.395212 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.395821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.401698 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.402171 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.402689 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.403371 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.403820 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.404238 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.533697 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.537135 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:11.541954 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-0615e4bb-8215-4187-8f35-4ede2e2a2389 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1502 microversion: 2.1 time: 0.151224 Sep 07 13:25:11.542610 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 597/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:11 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:12.565885 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:12.566630 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:12.573116 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.573601 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.574036 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.574769 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.575226 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.575658 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.714708 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:12.722370 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1255246f-fd70-409e-a093-21a79b2a87a5 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1502 microversion: 2.1 time: 0.160911 Sep 07 13:25:12.723234 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 592/1189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:12 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.628293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40595cbc-9335-4a2f-b52d-e3a702b860f7", "name": "network-vif-deleted", "tag": "40515bb4-71f0-4f7b-bf0f-fdf1c20e089c"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:13.633669 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:13.640321 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.640778 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.641199 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.654461 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] Creating event network-vif-deleted:40515bb4-71f0-4f7b-bf0f-fdf1c20e089c for instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 on hv-cinder-79053 Sep 07 13:25:13.660221 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-a364b061-ab79-4022-a7b2-522197f37a9c req-49416a37-8bde-4a18-a165-d61e18b641b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036183 Sep 07 13:25:13.660821 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 598/1190] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:13.745745 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.746316 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.748686 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:13.753953 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.754459 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.754901 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.755597 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.756051 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.756476 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.761197 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:13.791588 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.792075 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.792514 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.792957 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lazy-loading 'fault' on Instance uuid 40595cbc-9335-4a2f-b52d-e3a702b860f7 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:13.837510 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b485936b2671428c90e53dca7fe3dfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc90c1480c0f4bb187aa2cd7988adc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.845526 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-48a7e2fb-371d-4701-8111-2e8b6904a8af tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 200 len: 1304 microversion: 2.1 time: 0.103712 Sep 07 13:25:13.847520 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 593/1191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:14.871775 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:14.872423 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] [instance: 40595cbc-9335-4a2f-b52d-e3a702b860f7] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:14.879214 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.879700 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.880177 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.880862 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.881316 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.881740 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.895428 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] HTTP exception thrown: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Request method failure captured: Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 HTTP/1.1 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJuZmVaTgUokW9AAblRjvTETDeTsKo5QHbIA2f3J_6-Hz34gsF2PRcQvVXl6zDtDsgfQa4HoP36KprGTfJaCTskSEq5Q5PSeI5vDDtuSDzXXbZdVw7Yvj1pqRvHfxeQzRNAJvhaL1KGXa8GF5ICwRdcYtBw36QQpbCkiNWS_cebSp00 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: bc90c1480c0f4bb187aa2cd7988adc54 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesActionsTest-1301647681 Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:25:14.897081 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bc90c1480c0f4bb187aa2cd7988adc54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesActionsTest-1301647681 Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: bc90c1480c0f4bb187aa2cd7988adc54 Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesActionsTest-1301647681 Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesActionsTest-1301647681-project Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: b485936b2671428c90e53dca7fe3dfba Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesActionsTest-1301647681-project Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. Sep 07 13:25:14.898873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '40595cbc-9335-4a2f-b52d-e3a702b860f7'} Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:14.899936 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. Sep 07 13:25:14.901741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:25:14.904275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] Returning 404 to user: Instance 40595cbc-9335-4a2f-b52d-e3a702b860f7 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:14.904275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-cb5dcbff-9515-4159-b9a0-f873c0ec1370 tempest-VolumesActionsTest-1301647681 tempest-VolumesActionsTest-1301647681-project] 10.222.0.65 "GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7" status: 404 len: 111 microversion: 2.1 time: 0.031662 Sep 07 13:25:14.904275 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 599/1192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:14 2022] GET /compute/v2.1/servers/40595cbc-9335-4a2f-b52d-e3a702b860f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:06.770160 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-695027592", "imageRef": "dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b", "flavorRef": "452"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:06.777831 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:06.778626 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=7 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:06.981779 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] validate_networks() for None {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:26:07.254927 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:26:07.255356 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:26:07.255844 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:26:07.256258 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:26:07.256734 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:26:07.265655 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.266147 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.266627 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.268007 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.268467 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.268900 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.286380 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Getting quotas for project ca43a3ca68ee4f91bc192829b5d7fd13. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:26:07.290339 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Getting quotas for user d675fcd30ec74aecb7d14cf01b24348b and project ca43a3ca68ee4f91bc192829b5d7fd13. Resources: {'cores', 'ram', 'instances'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:26:07.301220 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:26:07.303522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd6cc2aa-6c36-4aed-be6b-9f7aeabff88b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:26:07.350966 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-212044ef-8845-48ec-bdf3-524e836290ca tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585319 Sep 07 13:26:07.351634 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 594/1193] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Sep 7 13:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:26:07.362452 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-88c4fee7-5fe0-49e4-b4be-39a8e8d3e8bf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:07.363073 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-88c4fee7-5fe0-49e4-b4be-39a8e8d3e8bf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:07.366124 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_api:SELECT=3 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:07.366840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell1:SELECT=4 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:07.531760 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-88c4fee7-5fe0-49e4-b4be-39a8e8d3e8bf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:07.539873 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-88c4fee7-5fe0-49e4-b4be-39a8e8d3e8bf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1214 microversion: 2.1 time: 0.181354 Sep 07 13:26:07.540425 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 600/1194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:07 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:08.565470 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:08.567522 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:08.576882 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.577366 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.577952 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.578683 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.579182 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.579942 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.656804 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:08.665214 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-30b0b7c5-c17b-4843-931c-474f8aa5355c tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1274 microversion: 2.1 time: 0.104905 Sep 07 13:26:08.666249 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 595/1195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:08 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:09.689960 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:09.690620 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:09.699358 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.700099 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.700715 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.701754 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.702376 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.703010 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.835363 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:09.842995 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-431d6ffb-873e-48d4-8141-0ae67b30e3e6 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.157672 Sep 07 13:26:09.843566 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 601/1196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:09 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:10.370767 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b22ee4-8b27-41d2-9681-89df16289b60", "tag": "428f7fde-207c-4a19-b096-44fda38b57ce"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:10.381489 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.381977 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.382471 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.397449 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] Creating event network-changed:428f7fde-207c-4a19-b096-44fda38b57ce for instance 08b22ee4-8b27-41d2-9681-89df16289b60 on hv-cinder-79053 Sep 07 13:26:10.402325 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-91ab638e-2c5a-40de-ac9f-752db5aa7e0e req-e13ddb29-097c-4a5f-9188-f6f9c7bfc5ec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035356 Sep 07 13:26:10.402962 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 596/1197] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:26:10.865950 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:10.866748 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:10.873167 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.873649 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.874084 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.874812 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:10.875983 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:10.876421 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.008684 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.016328 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-eff463fb-321e-4cd3-9acc-7c119bbf2622 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.154402 Sep 07 13:26:11.016932 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 602/1198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:10 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:12.041693 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.042554 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.048787 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.049277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.049713 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.050528 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.050994 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.051422 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.281200 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.289215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e465c82c-f9aa-4f2a-843b-c9042bda62b8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.252201 Sep 07 13:26:12.289797 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 597/1199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:13.313411 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.314067 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.320564 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.321051 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.321491 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.322178 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.322670 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.323110 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.451804 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:13.460617 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-e18cf1e0-8cc9-4fe6-9729-03326e1dc9a0 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.151828 Sep 07 13:26:13.461123 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 603/1200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:13 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:14.482562 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:14.483175 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:14.490096 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.490620 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.491061 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.491750 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.492209 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.492640 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.620751 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.629215 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6f7b64a0-a766-482b-9003-4c201bb76af8 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.150534 Sep 07 13:26:14.629771 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 598/1201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:14 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:15.652904 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:15.653547 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:15.660262 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:15.660741 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:15.661174 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:15.661852 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:15.662299 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:15.662746 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:15.791304 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:15.799385 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-9e01a2aa-6ed3-42c8-b828-a68478b17dec tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.150642 Sep 07 13:26:15.799946 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 604/1202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:15 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:16.783155 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b22ee4-8b27-41d2-9681-89df16289b60", "name": "network-vif-plugged", "status": "completed", "tag": "428f7fde-207c-4a19-b096-44fda38b57ce"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:16.794137 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.794811 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.795242 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.806937 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] Creating event network-vif-plugged:428f7fde-207c-4a19-b096-44fda38b57ce for instance 08b22ee4-8b27-41d2-9681-89df16289b60 on hv-cinder-79053 Sep 07 13:26:16.820983 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-798d6fe9-3258-4fb3-9e80-3559e8f4559f req-d43a7600-7e49-4986-a8da-1abc1796dd52 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041718 Sep 07 13:26:16.821744 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 599/1203] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:16.822876 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:16.823509 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:16.830840 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.831437 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.831885 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.832596 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.833057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.833486 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.982479 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:16.992004 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-5984b243-7f53-4040-9170-6f1130df919f tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.172912 Sep 07 13:26:16.992599 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 605/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:16 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:18.016661 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:18.017295 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:18.019450 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:18.020219 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:18.026557 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.027044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.027507 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.028201 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.028653 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.029105 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.160305 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:18.168477 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-288c0475-0da0-4b64-b9f1-21059085b03d tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1314 microversion: 2.1 time: 0.156746 Sep 07 13:26:18.169044 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 600/1205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:18 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:19.191607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.192216 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.194114 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG dbcounter [-] [120737] Writing DB stats nova_cell0:SELECT=2 {{(pid=120737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:19.199814 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.200293 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.200734 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.202280 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.202850 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.203277 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.332863 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:19.340505 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-78bb7466-fe91-46c1-8d89-a8f94d5ef820 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1463 microversion: 2.1 time: 0.152830 Sep 07 13:26:19.341058 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 606/1206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:19 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:19.386705 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.387213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.394213 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.394731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.395177 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.395869 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.396331 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.396762 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.421403 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:26:19.496472 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2d179d89-b6a5-4413-ae59-0fc7117b074e tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "DELETE /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 204 len: 0 microversion: 2.1 time: 0.113218 Sep 07 13:26:19.497057 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 601/1207] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Sep 7 13:26:19 2022] DELETE /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:26:19.505882 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.506607 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.512493 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.512987 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.514179 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.514935 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.515395 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.515828 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.648222 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.policy [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120737) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:19.656150 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-da599d53-4fe3-43ae-b112-79bd390abb80 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1469 microversion: 2.1 time: 0.154179 Sep 07 13:26:19.656719 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 607/1208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:19 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:20.680003 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:20.680747 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:20.687216 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:20.687698 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:20.688135 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:20.688827 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:20.689277 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:20.689700 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:20.820357 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:20.829123 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-99fb8c70-26f8-4a46-92a9-fe1067604ae4 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1469 microversion: 2.1 time: 0.153441 Sep 07 13:26:20.829690 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 602/1209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:20 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:21.734089 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b22ee4-8b27-41d2-9681-89df16289b60", "name": "network-vif-deleted", "tag": "428f7fde-207c-4a19-b096-44fda38b57ce"}]} {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:21.745685 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.746173 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.746708 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.764003 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.compute.server_external_events [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] Creating event network-vif-deleted:428f7fde-207c-4a19-b096-44fda38b57ce for instance 08b22ee4-8b27-41d2-9681-89df16289b60 on hv-cinder-79053 Sep 07 13:26:21.769788 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [req-d77a5b2a-63d4-4589-af21-d945c6e9f550 req-4a4760c4-06b8-4177-a09a-fdd14e7c9b41 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040674 Sep 07 13:26:21.770648 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 608/1210] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:21.851935 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:21.852566 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:21.859410 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.859886 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.860320 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.861004 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.861731 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.862327 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.895575 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.896217 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.896669 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.897110 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lazy-loading 'fault' on Instance uuid 08b22ee4-8b27-41d2-9681-89df16289b60 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:21.940281 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd675fcd30ec74aecb7d14cf01b24348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca43a3ca68ee4f91bc192829b5d7fd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:21.947956 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9ce8fa63-b21a-4f55-a6bf-01e8cdbba698 tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 200 len: 1304 microversion: 2.1 time: 0.099906 Sep 07 13:26:21.948521 dv-cinder-790535-42-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 603/1211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:21 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:22.972549 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Calling method '>' {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:22.973247 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.compute.api [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] [instance: 08b22ee4-8b27-41d2-9681-89df16289b60] Fetching instance by UUID {{(pid=120737) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:22.979397 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:22.979878 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:22.980311 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:22.981605 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Acquiring lock "d4c90cff-9714-42a7-a691-82968d71f0dc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:22.982057 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:22.982514 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG oslo_concurrency.lockutils [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Lock "d4c90cff-9714-42a7-a691-82968d71f0dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:22.995183 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.wsgi [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] HTTP exception thrown: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Request method failure captured: Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: request: GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 HTTP/1.1 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept: application/json Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Accept-Encoding: identity Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Connection: close Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Length: 0 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Content-Type: application/json Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Host: 10.222.0.65 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: Openstack-System-Scope: None Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Auth-Token: gAAAAABjGJvtcDQ47mQ-QmSFJOE__3WQoKqBpI11EgtodIS0QFrGjcunmowt3FaU46dfDLgKqXhBFkCwlht8WKVg4gD9d_Q2_fSQQsLz-d_MAuAv6ojBIEiPcxj4lOiC8mulucDwlXJ4vHVO9QR0yhmQGMfwsUZ1oYKybMfAeEWC5IG_lCFWnbQ Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Id: None Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Domain-Name: None Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Identity-Status: Confirmed Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Is-Admin-Project: True Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Id: default Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Domain-Name: Default Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Id: ca43a3ca68ee4f91bc192829b5d7fd13 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Project-Name: tempest-VolumesNegativeTest-680282581 Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Role: member,reader Sep 07 13:26:22.996773 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Roles: member,reader Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca43a3ca68ee4f91bc192829b5d7fd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca43a3ca68ee4f91bc192829b5d7fd13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca43a3ca68ee4f91bc192829b5d7fd13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca43a3ca68ee4f91bc192829b5d7fd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}] Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant: tempest-VolumesNegativeTest-680282581 Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Id: ca43a3ca68ee4f91bc192829b5d7fd13 Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-Tenant-Name: tempest-VolumesNegativeTest-680282581 Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User: tempest-VolumesNegativeTest-680282581-project Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Id: default Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Domain-Name: Default Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Id: d675fcd30ec74aecb7d14cf01b24348b Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: X-User-Name: tempest-VolumesNegativeTest-680282581-project Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: method: > Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: exception: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. Sep 07 13:26:22.998442 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: action_args: {'id': '08b22ee4-8b27-41d2-9681-89df16289b60'} Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: {{(pid=120737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:22.999561 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. Sep 07 13:26:23.001342 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.002918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: DEBUG nova.api.openstack.wsgi [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] Returning 404 to user: Instance 08b22ee4-8b27-41d2-9681-89df16289b60 could not be found. {{(pid=120737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:23.002918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: INFO nova.api.openstack.requestlog [None req-1777c152-f492-48e5-a82e-c03015d80bdf tempest-VolumesNegativeTest-680282581 tempest-VolumesNegativeTest-680282581-project] 10.222.0.65 "GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60" status: 404 len: 111 microversion: 2.1 time: 0.030341 Sep 07 13:26:23.002918 dv-cinder-790535-42-iscsi devstack@n-api.service[120737]: [pid: 120737|app: 0|req: 609/1212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:22 2022] GET /compute/v2.1/servers/08b22ee4-8b27-41d2-9681-89df16289b60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)